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the  potential  to  provide  this  access  with  little  economic  investment  is  the  mobile  Personal 
Digital  Assistant.  The  authors  address  a  variety  of  wireless  technologies  and  security 
concerns  regarding  real-time  access  to  patient  data.  The  family  practice  staff  at  the  Naval 
Hospital  Lemoore  explored  and  contrasted  the  capabihties  of  commercially  available 
PDAs,  wireless  interfaces,  and  medical  software  apphcations  to  ascertain  their  value 
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and  capturing  charges.  Survey  tools  generate  a  requirements  standard  for  deployment  of 
this  technology  within  the  Mihtary  Health  System  on  an  enterprise- wide  scale  with  a 
hybrid  approach  to  packaging  based  on  functionahty.  The  authors  recommend  the 
Mihtary  Health  System  embrace  this  technology  as  a  means  to  reahze  its  vision  of  best 
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1.  INTRODUCTION 


A.  PURPOSE 

This  thesis  focuses  on  evaluating  personal  digital  assistants,  wireless 
technologies,  medical  software  applications  and  generates  a  requirement  to  enable  the 
deployment  of  a  comprehensive  system  that  will  provide  accurate  access  to  diagnostic 
and  billing  information.  This  technology  will  streamline  processes  and  integrate  data 
collection  and  information  retrieval,  thus  reducing  time  spent  on  administrative  tasks  and 
increasing  the  time  providers  spend  with  their  patients,  which  will  enhance  quality  of  care 
and  patient  satisfaction  levels  and  may  lead  to  safer  outcomes.  In  addition,  more 
complete  and  accurate  patient  encounter  documentation  can  dramatically  reduce  third 
party  revenue  losses  and  greatly  reduce  biUing/coding  time. 

The  following  table  presents  recommended  reading  indicated  by  highlighted  areas 
based  on  functionality. 


Providers, 

Nurses, 

Clinicians 

COs/XOs, 

Directors 

Network 
Administrat 
ors.  Security 
&  Privacy 
Officers 

Comptroller 

Billing 

Qaims 

CIOs, 

TMA, 

Program 

Offices 

Chapter  I 

Section  B  only 

Chapter  II 

Chapter  HI 

Sections  C,D,E 

Chapter  IV 

Chapter  V 

Table  5.5  only 

Chapter  VI 

Chapter  VII 

Section  B  only 

Section  B  only 

Section  B  only 

Chapter  VIII 

Appendix  A 

Appendix  B 

Appendix  C 

Appendix  D 

Table  1.1.  Suggested  Reading  by  Occupation. 


1 


B.  MOTIVATION 

1.  Administrative  Burdens  and  Lost  Revenue 

Managed  care  changed  physician  incentives  to  control  healthcare  costs.  Managed 
care  has  also  dramatically  increased  the  administrative  burden  placed  on  physicians. 
Patient  expectations  have  risen  and  regulatory  comphance  has  become  more  intricate. 
Physicians  must  now  follow  a  series  of  insurer  and  health  plan  medical  guidelines  as  well 
as  prescribe  only  those  medications  that  appear  on  an  approved  formulary.  Physicians 
lack  the  requisite  administrative  tools,  time,  and  expertise  to  manage  these  intricacies  and 
clashes  with  management  abound  over  inaccurate  and  incomplete  patient  data  necessary 
for  reimbursement.  Inaccurate  and  incomplete  patient  encounter  documentation  results  in 
dramatic  decreases  in  revenue  collection.  A  WR  Hambrech  &  Co  (WRH  &  Co)  report 
which  analyzed  data  from  the  Healthcare  Financing  Administration  (HCFA)  and 
healthcare  industry  studies  indicates  that  $25  billion  is  lost  in  denied  or  reduced  fee-for- 
service  claims,  annually.  A  Synergy  Medical  Informatics  Study  according  to  WRH  &  Co 
deduced  that,  "Lost  bilhngs  average  approximately  $60,000  per  year  for  each  of  the 
roughly  450,000  physicians  in  active  clinical  practice  in  the  United  States."  (Fisher, 
2000)  These  numbers  are  staggering  and  yet  fail  to  account  for  delays  in  reimbursement 
due  to  coding  errors  and  patient  encounters  that  are  poorly  documented  or  not 
documented  at  all. 

2.  Medical  Errors 

The  National  Academy  of  Sciences'  Institute  of  Medicine  Division's  report  titled. 
To  Err  is  Human,  stated  that  the  cost  of  injuries  resulting  from  medical  errors  exceeds 
$17  billion  and  accounts  for  44,000  deaths,  annually.  (Hamblen,  2000)  The  report  further 
indicated  that  7,000  plus  deaths  in  1993  were  the  direct  result  of  medication  errors.  These 
errors  are  a  consequence  of  using  the  incorrect  drug  name,  inaccurate  dose  calculations, 
and  indistinct  dosage  directions.  (Chesanow,  2000)  Another  study  indicated  that  over  9 
million  prescriptions  are  rechecked  due  to  illegible  handwriting  or  to  clarify  a 
discrepancy  over  insurance/  formulary  approval.  (Freudenheim,  2001) 
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C.  RESEARCH  QUESTIONS 

The  primary  research  question  addressed  in  this  thesis  is:  WiU  deploying  PDAs 
allow  providers  to  use  previously  not  easily  attainable  information  when  needed  during 
doctor- patient  interactions? 

Ancillary  research  questions  include  the  following: 

•  Can  administrators  and  providers  see  a  reduction  in  administrative  tasks, 
cost  savings,  and  increased  third-party  revenue? 

•  Is  there  a  requirement  to  integrate  PDA  technology  with  Department  of 
Defense  (DoD)  Medical  legacy  systems? 

•  Can  quality  of  care  and  patient  satisfaction  increase  by  using  PDA 
technology? 

•  Can  providers  capitahze  on  PDA  technology  and  utihze  its'  full  potential? 

•  Can  wireless  real-time  access  to  patient  data  reduce  medical  errors? 

D.  SCOPE  OF  THESIS 

This  thesis: 

•  Provides  a  broad  perspective  on  the  uses  of  PDA  technology  as  a  business 
tool,  both  chnical  and  administrative. 

•  Generates  a  requirements  standard  through  the  use  of  survey  tools. 

•  Demonstrates  the  benefits  of  deploying  PDAs  on  an  enterprise- wide  scale 
with  a  uniform  software  and  training  package. 

•  Explores  the  benefits  of  wireless  connectivity  of  the  PDA  in  the  clinical 
environment. 

•  Examines  issues  of  connectivity,  security,  ease  of  use,  network 
compatibihty,  rehabihty  and  user  ease  of  administration/time  reduction. 

•  Identifies  appropriate  key  intangible  factors. 

E.  METHODOLOGY 

The  methodology  used  for  this  research  consists  of  the  following  steps: 

•  Conducting  a  literature  search  of  books,  joumal/magazine  articles,  CD- 
ROM  systems,  and  other  hbrary  information  resources  for  the  years  1985  - 
2001  using  key  word  queries. 

•  Conducting  a  thorough  review  of  current  Joint  Commission  on  the 
Accreditation  of  Healthcare  Organizations  (JCAHO)  standards  and  the 
Health  Insurance  Portability  and  accountabihty  Act  of  1996  (HIPAA). 

•  Exploring  and  contrasting  the  capabihties  of  various  state-of-the-art  2001 
PDAs. 
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•  Determining  how  eaeh  system  provides  management  and  providers  with 
the  tools  and  information  to  make  sound,  informed,  and  timely  deeisions. 

•  Interviewing  other  healtheare  organizations  and  medieal  technology 
companies  that  may  add  value  to  this  thesis. 

•  Discussing  the  requisite  changes  in  management/provider  philosophy  that 
must  accompany  deployment  of  this  technology. 

•  Developing  and  testing  solutions  in  a  laboratory  environment  - 
implementing  and  analyzing  those  solutions  in  the  field. 

•  Developing  a  user  requirement  survey  and  promulgating  that  survey 
throughout  DoD  Medicine  as  well  as  compiling  the  results  for 
requirements  generation. 

•  Assessing  user  and  satisfaction  levels  using  questionnaires,  interviews, 
and  observations. 

•  InstaUing  wireless  interfaces  on  devices  and  within  Naval  Hospital 
Lemoore. 

F.  ORGANIZATION  OF  STUDY 

Chapter  n  offers  the  reader  a  brief  introduction  to  background  works  in  hand-held 
computers,  including  apphcations  in  the  pubhc  and  private  sectors. 

Chapter  IH  details  commercially  available  hardware  (personal  digital  assistants 
and  wireless  interfaces)  and  medical  software  apphcations  that  were  evaluated  by  Naval 
Hospital  Lemoore’ s  family  practice  clinic. 

Chapter  IV  examines  the  difficulties  associated  with  documenting  patient 
encounters  and  capturing  charges  and  proposes  a  solution  using  PDA  technology. 
Furthermore,  this  chapter  details  two  case  studies  which  illustrate  how  these  difficulties 
were  successfuUy  eliminated  and  explores  the  feasibihty  and  value  of  using  an  HL/7 
interface  to  provide  patient  information  to  a  calendar  on  a  PDA. 

Chapter  V  explains  the  development  and  issuance  of  the  user  requirement  survey 
disseminated  in  this  study,  and  subsequent  analysis  and  presentation  of  survey  findings.  It 
also  examines  the  results  of  a  second  post-testing  phase-out  survey  developed  for  the 
participants  assisting  with  hardware  and  software  assessment  at  Naval  Hospital  Lemoore. 

Chapter  VI  examines  the  wireless  networking  technologies  currently  available  for 
use  with  Personal  Digital  Assistants.  These  technologies  include  Frequency- Hopping 
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and  Direct- Sequencing  Spread  Spectrum,  Coded  Orthogonal  Frequency  Domain 
Multiplexing,  Infrared  and  Bluetooth. 

Chapter  VII  identifies  the  federal  legislation  that  wiU  drive  security  measures  for 
electronic  data,  both  at  rest  and  in  transit,  within  the  healthcare  industry.  It  explores 
solutions  for  safeguarding  that  data,  using  certification,  integrity  and  authentication  as 
guidehnes.  Encryption  solutions  are  presented,  and  weaknesses  are  identified. 

Chapter  Vni  provides  conclusions  arrived  at  during  this  study  and  apphes  them 
toward  the  military  healthcare  environment.  Recommendations  for  future  research  are 
also  presented  in  this  chapter. 


5 


THIS  PAGE  INTENTIONALLY  LEET  BLANK 


6 


n.  BACKGROUND  AND  RELATED  WORK 


A.  INTRODUCTION 

In  this  chapter  the  authors  explore  physician  acceptance  of  mobile  devices  as 
computer  technology  transitions  from  administrative  offices  to  physician  desktops  and 
patient  examination  rooms.  Also  explored  are  the  early  generations  of  hghtweight  and 
portable  devices,  which  are  replacing  these  large  desktop  computers.  Examined  are 
related  studies  of  work  in  both  the  private  and  pubhc  sectors. 

In  the  early  1990's,  the  computer  and  communication  industries  realized 
tremendous  growth  in  the  mobile  device  sector.  Mobile  devices  now  abound.  They 
interrupt  the  President  of  the  United  States  during  press  conferences.  They  are  an 
annoyance  in  restaurants  when  someone  at  the  next  table  feels  they  are  too  important  to 
turn  off  their  ceU  phone  for  one  hour.  With  global  positioning  sateUites,  they  provide 
guidance  on  roadways  and  on  golf  course  fairways  and  through  wireless  capabilities 
allow  stock  market  transactions  from  a  lounge  chair  on  the  beach.  On  the  other  hand,  the 
integration  of  PDAs  in  healthcare  although  stiU  in  its  infancy  is  lacking  in-depth  research, 
which  examines  chnical  practice  management  efficiencies  and  improvements  in  quahty 
of  care.  However,  several  articles  do  discuss  briefly  the  processes  of  implementation  and 
physician  interaction  with  the  devices. 

B.  PHYSICIAN  ACCEPTANCE 

I.  Migration 

Traditionally,  computers  in  healthcare  simply  provided  aid  in  the  performance  of 
administrative  tasks  such  as  scheduling  and  billing.  Computer  technology  has  since 
migrated  from  back  offices  and  reception  desks  to  physician  desktops  and  patient 
examination  rooms  as  a  need  arose  for  that  technology  to  integrate  with  hospital 
information  systems,  access  automated  patient  records,  interface  with  pharmacy  systems, 
and  even  to  provide  patient  summaries  for  on-caU  physicians.  Despite  stereotypes  that 
physicians  are  technophobes  and  resist  change,  physicians  are  embracing  this  new 
technology.  The  business  drivers  within  managed  care  are  mandating  that  physicians 
have  point-of-care  (P-O-C)  access  to  medical  reference  data,  patient  specific  data, 
formularies,  treatment  protocols,  and  billing/coding  information.  Concurrently,  the 
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technological  revolution  is  allowing  for  large  desktop  computers  and  monitors,  dumb 
terminals,  a  pocket  fuU  of  3  x  5  cards  containing  medical  reference  data,  and  stickles  with 
hurriedly  written  patient  encounter  notes  to  be  altogether  replaced  by  hghtweight  and 
portable  systems  with  powerful  features. 

2.  The  Technology 

The  early  1990's  saw  a  new  generation  of  hand-held  computers.  These  hand-helds 
weighed  a  pound  or  less,  were  half  the  cost  of  desktop  PCs,  possessed  the  memory 
necessary  to  store  adequate  amounts  of  medical  reference  and  patient  specific  data,  and 
did  not  require  the  long  boot  up  period  of  desktop  PCs. 

The  authors  of  this  study  found  the  majority  of  family  practice  physicians 
embraced  this  technology  virtually  from  its  inception.  It  may  be  the  breadth  of  diagnoses 
encountered,  mral  practice  locations,  and/or  greater  involvement  in  administrative  and 
financial  tasks  that  made  these  early  PDAs  an  invaluable  tool  to  them. 

One  such  device,  the  Apple  Newton  Message  Pad  120  released  in  1995  contained 
a  20  mHz  processor,  large  screen  with  a  resolution  of  320  x  240  pixels,  built  in  speaker, 
20  -  50  hour  battery  fife,  optional  fax/  modem,  handwriting  recognition,  infra  red 
capabihty,  weighed  1  pound,  and  measured  8  x  4  x  1.2  inches.  However,  it  was  not 
without  limitations.  Its  handwriting  recognition  software  was  inconsistent  and  required  a 

lengthy  period  to  adapt  to  the  users  handwriting.  It  had  no  illumination  (screen  not 

backht)  making  it  difficult  to  view  text  in  poorly  lit  areas  and  its  2  MB  memory 
precluded  the  loading  of  multiple  large  apphcations.  Another  much  smaller  device,  the 
Frankhn  Digital  Book  System  contained  a  16  mHz  processor,  a  screen  with  a  resolution 
of  160  X  40  pixels,  200  hour  battery  life,  a  key  board,  weighed  4  ounces,  and  measured  5 
X  3.5  X  0.5  inches.  With  no  operating  system,  it  was  primarily  a  reference  tool  capable  of 
holding  two  20  MB  digital  books.  (EbeU,  1995)  With  the  next  generation  of  PDAs  and 
medical  apphcations  available  in  the  market  place,  the  PDA  has  evolved  into  a  decision 

support  tool  that  is  saving  fives.  (Ram,  1994)  Physicians  in  the  private  sector  are  using 

PDAs  for  practice  management,  patient  tracking,  dosage  and  pregnancy  calculations, 
treatment  protocols,  pharmaceutical  data  and  prescription  ordering,  patient  education, 
coding,  documenting  patient  encounters,  and  stress  relief  (playing  games). 
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c. 


RELATED  WORK 


1.  Private  Sector 

This  section  lists  related  studies  of  work  in  the  private  sector  including  Kaiser 
Permanente,  Wake  Forest  University  School  of  Medicine,  the  University  of  Cahfomia 
and  Thomas  Jefferson  University. 

a.  Kaiser  Permanente 

At  Kaiser  Permanente's  offices  in  Woodbiidge  VA,  physicians  are  using 
pahn  pilots  and  an  application  named  ePhysician  to  wirelessly  locate  an  automated 
patient  record,  screen  for  dmg  allergies/  contraindications,  verify  insurance  coverage,  and 
transmit  prescriptions  to  the  pharmacy.  ePhysician  reduces  callbacks  from  pharmacies 
and  eliminates  the  need  to  decipher  scribbles  on  a  prescription  pad.  (Joyce,  2000) 

b.  Wake  Forest  University  School  of  Medicine 

At  Wake  Forest  University  School  of  Medicine  in  Winston-Salem  NC,  all 
third  year  medical  students  receive  a  palm  pilot.  "The  program  has  enabled  students  to 
monitor  patient  diseases  and  other  ailments  from  the  outset  and  observe  their  progression 
with  amazing  accuracy."  (Bass,  2000) 

c.  University  of  California,  Davis 

The  Director  of  Psychiatric  Informatics  and  Assistant  Chnical  Professor  at 
the  University  of  Cahfomia,  Davis,  John  Lou,  M.D.  stated  that  aU  of  his  medical  students 
carry  pahn  devices  loaded  with  various  approved  medical  apphcations.  He  views  PDAs 
as  indispensable  teaching  devices  and  as  tools  which  aid  physician  chnical  decision¬ 
making.  (Lou,  2001) 

d.  Thomas  Jefferson  University 

Richard  H.  Epstein,  M.D.,  Associate  Professor,  Department  of 
Anesthesiology  at  Thomas  Jefferson  University,  Philadelphia,  PA  states  that  medical 
schools  across  the  country  are  reahzing  the  importance  of  training  medical  students  in 
what  he  termed  medical  informatics.  With  biomedical  devices  such  as  fetal  monitors  and 
medical  resonance  imagers  (MRI)  storing  or  transmitting  patient  data,  it  is  now  necessary 
for  a  physician  to  be  computer  hterate  in  order  to  leverage  that  information  to  enhance 
the  quality  of  healthcare.  (Epstein,  2001) 
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2.  Public  Sector 

As  the  authors  sought  information  on  this  subject  only  occasional  pockets  of  PDA 
technology  use  were  found  within  the  Department  of  the  Navy  (DoN)  and  only  draft 
pohcies  regarding  their  use.  The  Navy  is  beginning  to  bring  this  technology  to  ships  and 
hospitals  with  pilot  programs  focusing  on  wireless  e-mail  and  administrative  efficiencies. 

a.  The  Space  and  Naval  Warfare  Systems  Command  (SPAWAR) 

SPAWAR  systems  center  in  Chesapeake  VA  is  conducting  a  proof  of 

concept  study  utihzing  an  Environmental  Health  Module  of  the  Shipboard  Automated 
Medical  System  (SAMS)  which  has  been  modified  to  mn  on  the  palm  operating  system. 
A  corpsman  (preventive  medicine  technician)  using  a  stylus  can  record  heat  stress  survey 
data,  pest  control  inspections,  and  potable  water  test  results  and  then  transmit  that  data  to 
the  SAMS  database.  This  proof  of  concept  holds  tremendous  potential  for  increasing 
administrative  efficiencies  by  reducing  data  errors  and  redundancy,  paper  record  keeping, 
and  streamhning  supply  management.  (SPAWAR,  2000) 

b.  The  Uniformed  Services  University 

The  Uniformed  Services  University,  Department  of  Biomedical 
Informatics,  Bethesda,  Maryland  provides  PDAs  for  its  healthcare  students  as  a  means  to 
communicate  with  students  at  chnical  sites,  enter  chnical  encounter  data,  look  up  medical 
reference  material,  make  calculations,  and  access  calendar  information.  (USUHS,  2001) 

D.  SUMMARY 

The  business  drivers  within  managed  care  are  mandating  that  physicians  have 
point-of-care  access  to  medical  reference  data,  patient  specific  data,  formularies, 
treatment  protocols,  and  biUing/coding  information.  Physicians  in  the  private  sector  are 
using  PDAs  for  practice  management,  patient  tracking,  dosage  and  pregnancy 
calculations,  treatment  protocols,  pharmaceutical  data  and  prescription  ordering,  patient 
education,  coding,  documenting  patient  encounters,  and  stress  rehef  (playing  games). 
Private  sector  uses  that  were  examined  included;  Kaiser  Permanente,  Wake  Forest 
University  School  of  Medicine,  University  of  Cahfomia,  and  Thomas  Jefferson 
University.  Pubhc  Sector  uses,  although  limited  and  lacking  coordination,  included 
SPAWAR,  and  The  Uniformed  Services  University. 


10 


m.  OPERATIONAL  FAMILIARIZATION 


A.  INTRODUCTION 

In  this  chapter  the  authors  explore  the  technology  employed  at  a  Department  of 
Navy  (DoN)  Medical  Treatment  Facility  (MTF)  test  site  to  set  a  foundation  for 
subsequent  chapter  discussions  and  generation  of  requirements  for  similar  integration 
with  DoD  Medical  information  architectures.  Detailed  are  two  categories  of  hardware 
installed  for  the  purposes  of  this  study  at  Naval  Hospital  Lemoore,  PDAs  and  wireless 
interfaces.  Medical  software  apphcations  deployed  on  the  PDAs  were  selected  based  on 
physician  reviews  and  include  at  least  one  apphcation  from  each  of  the  following 
categories;  the  Drug  Databases,  Medical  Information  Databases,  Patient  Billing  and 
Coding,  Medical  Calculators,  and  Patient  Information  Databases.  This  chapter  offers  a 
sample  of  how  a  physician  might  use  a  PDA  during  a  patient  encounter. 

With  today's  technological  and  business  practice  revolutions,  private  sector 
healthcare  organizations  are  on  the  verge  of  significant  improvements  in  the  dehvery  of 
care.  Mobile  inventory  management,  medication  administration  management,  and  a  host 
of  tools,  which  reduce  administrative  functions  and  medical  errors,  are  being  integrated 
into  current  hospital  information  architectures.  These  organizations  are  dramatically 
enhancing  business  efficiencies  and  their  bottom  tines  as  well  as  making  tremendous 
strides  in  improving  the  quality  of  care  delivered  to  patients.  The  public  sector  is  now 
under  more  and  more  scmtiny  to  employ  these  same  business  and  clinical  efficiencies. 
(Fisher,  2000,  Levine,  2000,  and  Freudenheim,  2001) 

The  purchase  prices  quoted  in  this  chapter  are  direct  quotes  from  vendor  web  sites 
are  subject  to  change  and  do  not  reflect  possible  government  discounts.  If  interested  in 
purchasing  any  of  these  products  please  contact  the  vendor's  government  representative. 

B.  PARTICIPATING  MEDICAL  TREATMENT  FACILITY  (MTF)  AND 

PERSONNEL 

Naval  Hospital  Lemoore  (NHL)  located  within  the  Naval  Air  Station  (NAS) 
Lemoore,  CA  is  a  DoN  MTF  with  an  Administrative  Support  Unit  in  Monterey,  CA  and  a 
Branch  Medical  Ctinic  in  Fallon,  Nevada.  NHL  provides  healthcare  services  to  more  than 
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25,000  active  duty  service  members  (5,000  located  on  NAS),  family  members,  and 
retirees.  NHL's  statistics  are  illustrated  in  Table  3.1. 


Naval  Hospital  Lemoore  Statistics 

Staffing 

Medical  Corps  officers 

20 

Nurse  Corps  officers 

30 

Medical  Service  Corps  officers 

15 

Enhsted  personnel 

150 

CivUian  staff 

150 

Contract  physicians  and  nurses 

25 

Beds 

Inpatient  Beds 

16  (I  positive  pressure  isolation,  1  negative 
pressure  isolation,  8  medical  surgical  beds, 
and  6  labor,  delivery,  recovery  and  post¬ 
partum) 

Patient  Visits/Admissions 

Outpatient  visits 

Average  1 1,000  per  year,  916  per  month 

Inpatient  admissions 

Average  780  per  year,  65  per  month 

Table  3.1.  Naval  Hospital  Lemoore  Statistics  (From  NHL,  2001). 

NHL  was  chosen  as  a  test  site  for  this  study  based  on  several  factors  most  notably 
its  receptive  Family  Practice  physicians  and  its  strategic  goal  for  technology  integration. 
Their  technology  goal  states,  "Seek,  investigate  and  integrate  present  and  future 
technologies  designed  to  enhance  high  quahty  chnical  outcomes,  decrease  healthcare 
dehvery  costs,  and  improve  management  processes  and  organizational  performance." 
(NHL,  2000) 

The  team  of  family  practice  chnic  evaluators  who  tested  and  reviewed  the 
hardware  and  medical  apphcation  software  is  shown  in  Table  3.2. 
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Hardware  and  Software  Evaluators 

Blackwood,  Carol  L.,  is  a  Family  Practice  Physician  and  a  Lieutenant  Commander  in  the 
United  States  Naval  Reserve  (USNR)  Medical  Corps.  She  is  a  prior  Naval  Intelligence 
Officer,  attended  the  University  of  Vermont  College  of  Medicine,  and  completed  her 
Family  Practice  Residency  at  Naval  Hospital,  Camp  Pendleton. 

Brown,  Chawn  T.,  is  a  Registered  Nurse  and  Lieutenant  in  the  United  States  Navy 
(USN)  Nurse  Corps  with  chnical  experience  in  Internal  Medicine,  Post- Anesthesia,  and 
Family  Practice.  He  attended  Florida  A&M  University  where  he  received  a  B.  S.  in 
Nursing. 

Burgess,  Lloyd  G.,  is  a  Family  Practice  Physician  and  a  Lieutenant  Commander  in  the 
USN  Medical  Corps.  He  attended  Finch  University  of  Health  Sciences/Chicago  Medical 
School,  completed  his  Family  Practice  Internship  at  Methodist  Medical  Center  in  Hhnois, 
and  completed  his  Family  Practice  Residency  at  Naval  Hospital,  Camp  Pendleton.  He  is  a 
member  of  the  American  Academy  of  Family  Physicians  and  the  Christian  Medical  and 
Dental  Association. 

Howard,  Christina  L.,  is  a  Nurse  Practitioner  and  Commander  in  the  USN  Nurse  Corps 
with  over  23  years  of  nursing  experience.  She  attended  Pacific  Lutheran  University 
where  she  received  a  M.  S.  in  Nursing.  She  is  a  member  of  the  American  Nurses 
Association,  American  Academy  of  Nurse  Practitioners,  the  Uniformed  Nurse 
Practitioners  Association  and  Sigma  Theta  Tau  National  Nursing  Honor  Society. 

Lee,  Benjamin  K.,  is  the  Head  of  Naval  Hospital  Lemoore's  Family  Practice  Chnic  and  a 
Lieutenant  Commander  in  the  USN  Medical  Corps.  He  attended  Albany  Medical  College 
in  New  York  and  completed  his  Family  Practice  Residency  at  Naval  Hospital,  Camp 
Pendleton.  He  is  a  member  of  the  American  Academy  of  Family  Physicians. 

Madewell,  Lawrence  J.,  is  a  Family  Practice  Physician  and  a  Lieutenant  in  the  USN 
Medical  Corps.  He  attended  medical  school  at  the  University  of  Cincinnati  and 
completed  his  residency  at  Valley  Medical  Center,  Renton,  WA.  He  is  a  member  of  the 
American  Academy  of  Family  Physicians  and  the  Uniformed  Services  Academy  of 
Family  Physicians. 

Malik,  Mohammad  A.,  is  a  Family  Practice  Physician  and  a  Lieutenant  in  the  USN 
Medical  Corps.  He  attended  medical  school  at  Finch  University  of  Health 
Sciences/Chicago  Medical  School  and  completed  his  residency  at  University  of  Hhnois’ 
St.  Francis  Hospital  of  Evanston.  He  is  a  member  of  the  American  Academy  of  Family 
Physicians.  He  was  also  a  beta  tester  of  the  Windows  CE  based  Iscript  handheld  system. 

Miller,  Patricia  J.,  is  a  Registered  Nurse  and  an  Ensign  in  the  USN  Nurse  Corps  wth 
one-year  clinical  experience  in  ambulatory  care.  She  received  her  B.  S.  in  Nursing  from 
Eresno  State  University  in  Cahfomia  and  is  a  member  of  Sigma  Theta  Tau  National 
Nursing  Honor  Society. 

Partridge,  David  R.,  is  a  Registered  Nurse  and  a  Eieutenant  in  the  USN  Nurse  Corps. 
He  received  his  B.  S.  in  Nursing  from  Idaho  State  University  and  has  chnical  experience 
in  Neonatal  Intensive  Care,  Antenatal  and  Post-Partum. 

Table  3.2.  Pamily  Practice  Chnic  Evaluators. 
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C.  HARDWARE 

The  hardware  used  for  the  study  comes  in  two  major  categories,  Personal  Digital 
Assistants  (PDAs)  and  wireless  interfaces.  The  hardware  includes  the  Palm  Vx,  symbol 
SPT  1700,  Handspring  Visor  Platinum,  Compaq  Ipaq  3630,  PDAs  and  CreditCard 
Wireless  Ethernet  adapter,  SpringPort  wireless  Ethernet  Module,  Wireless  Ethernet 
Access  Point,  Symbol  Spectmm24  Access  Point  AP-3020.  The  PDAs  under  study  are: 

1.  PDAs 

a.  Palm  Vx 

Palm  Incorporated  first  introduced  the  Pilot  1000  and  Pilot  5000 
organizers  in  March  1996.  In  December  1997,  Palm  began  licensing  the  Palm  OS 
platform.  Eeveraging  its  ‘Trrst  mover”  advantage.  Palm's  operating  system  quickly 
dominated  the  marketplace.  Palm  introduced  the  hghtweight  and  compact  Palm  Vx  in 
October  1999.  Currently  there  are  over  10,000  third-party  software  applications  for  Palm 
OS  based  handhelds.  Table  3.3  provides  hardware  specifications  on  the  Palm  Vx  at  the 
time  of  this  study.  (Palm,  2001) 


Eigure  3.1.  Palm  V x  (Prom  Palm,  200 1 ) . 

b.  Symbol  SPT  1700 

Symbol  Technologies  Incorporated  along  with  its  strategic  partner  Sybase 
iAnywhere  provide  technological  solutions  to  healthcare  organizations,  which  afford 
more  mobile  healthcare.  Symbol  was  founded  in  1975  and  introduced  the  SPT  1700  and 
wireless  PAN  product  hne  in  2000.  The  Symbol  SPT  1700  family  features  include 
scanning,  wireless  connectivity,  and  mggedness.  Table  3.3  provides  hardware 
specifications  on  the  Symbol  SPT  1700  at  the  time  of  this  study.  (Symbol,  2001) 
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Figure  3.2.  Symbol  SPT  1700  Series  (From  Symbol,  2001). 
c.  Handspring  Visor  Platinum 

Jeff  Hawkins  and  Donna  Dubinsky  co- founded  Handspring.  Impressively, 
Hawkins  is  credited  with  inventing  the  Palm  Pilot  and  he  was  the  founder  of  Palm 
Computing,  which  he  has  since  sold.  Table  3.3  provides  hardware  specifications  on  the 
Handspring  Visor  Platinum  at  the  time  of  this  study.  (Handspring,  2001)  Table  3.3 
provides  hardware  specifications  on  the  Palm  Vx  at  the  time  of  this  study.  NOTE: 
Adding  the  wireless  module  on  two  test  units  did  require  the  removal  of  the  16  MB 
memory  modules,  a  design  difficulty. 


Figure  3.3.  Handspring  Visor  Platinum  (From  Handspring,  2001). 

d.  Compaq  Ipaq  3630 

Compaq  Computer  Corporation  was  founded  in  1982.  In  November  1996, 
Compaq  introduced  the  handheld  personal  computer  (PC),  the  PC  companion  and  in 
April  2000  introduced  the  iPAQ  Pocket  PC.  Table  3.3  provides  hardware  specifications 
on  the  Compaq  Ipaq  3630  at  the  time  of  this  study.  (Compaq,  2001)  Note:  The  optional 
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expansion  packs  added  to  bulkiness  and  to  date  there  are  fewer  applications  written  for 
Pocket  PC  OS. 


Figure  3.4.  Compaq  iPAQ  Pocket  PC  3630  (From  Compaq,  2001). 

2.  Wireless  Interfaces 

a.  CreditCard  Wireless  Ethernet  Adapter 

This  IEEE  802.11b  compliant  adapter  provides  secure  real-time  access  to 
your  Eocal  Area  Network  (EAN)  wirelessly  through  a  Wireless  Eocal  Area  Network 
(WEAN).  It  eliminates  the  need  for  additional  hard  wiring  and  is  scalable.  The  cost  is  just 
over  $100.00.  Xircom  offers  a  discounted  set  with  2  adapters  and  its  wireless  Ethernet 
access  point  for  $599.99  (Xircom,  2001) 

b.  SpringPort  Wireless  Ethernet  Module 

This  module  made  by  Xircom  allows  wireless  access  to  IEEE  802.11b 
(WEAN)  through  the  Handspring  Visor  Series  of  PDAs.  It  eliminates  the  need  to  Hot 
sync  in  the  cradle  on  a  desktop,  supports  peer-to-peer  links  between  devices,  and 
provides  40  or  128  bit  encryption.  It  costs  $299  and  does  add  size  and  weight  to  the 
handheld.  The  Visor  Platinum  requires  a  charger  for  the  module,  as  it  is  not  supplied 
power  from  the  Platinum's  AAA  batteries.  The  charger  is  included  with  the  module.  To 

surf  the  web  one  must  purchase  Handspring's  web  browser  software  called  Blazer  at  a 

nominal  cost.  Note:  Network  configuration  was  relatively  simple  despite  a  known  error  in 
the  instmctions.  (Xircom,  2001) 
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Vendor  Defined  Hardware  Characteristics 

Pahn  Vx 

Compaq  Ipaq 
3630 

Handspring 

Visor 

Platinum 

Symbol  SPT 
1700 

Memory 

RAM 

ROM 

8  MB 

N/A 

32  MB 

16  MB 

8  MB 

8  MB 

2  MB 

Operating  System 

Palm  v3.5 

Pocket  PC 

Pahn  v3.5.2 

Pahn  v3.5 

Processor 

16  MHz 

206  MHz 

33  MHz 

16  MHz 

Display 

BAV 

Color 

BAV 

BAV 

Resolution 

160  X  160 

240  X  320 

160  X 160 

160  X  160 

N/A 

Yes 

Yes 

N/A 

Battery 

Rechargeable 

Rechargeable 

AAA 

Rechargeable 

Battery  Life 

30  days 

14  hours 

2  months 

N/A 

(Energy  Mgt. 
System) 

Wireless 

Communications 

N/A 

802.11b 

802.11b 

802.11  or 
802.11b 

Speaker/Microphone 

N/A 

Yes 

Yes 

(Expansion 

Module) 

N/A 

Weight 

4.0  oz 

6.3  oz 

(not  including 
modules) 

5.4  oz 

(not  including 
modules) 

11.8  oz 

Size 

4  5"  X  3  1"  X  4 

5.11"  X  3.28"  X 
.62 

(not  including 
modules) 

4.8"  X  3"  X  .7" 
(not  including 
modules) 

7"  X  3.6"  X  1 

N/A 

N/A 

N/A 

Yes 

Ruggedized 

N/A 

N/A 

N/A 

Yes 

Environmental 

Sealing 

N/A 

N/A 

N/A 

Yes 

Cost  (no  discounts 
apphed) 

$299 

$599 
(with 
expansion 
pack,  no 
modules) 

$249 

(not  including 
modules) 

$1,765 
(with  wheless 
ethemet 
adapter) 

Table  3.3.  Vendor  Defined  Characteristics. 
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c.  Wireless  Ethernet  Access  Point 

This  access  point  can  accommodate  802.11b  compliant  adapters;  it  is 
small  and  lightweight.  It  supports  40- bit  encryption.  It  features;  a  data  rate  of  either  11 
Mbps,  5.5,  2,  1,  Direct  Sequence  Spread  Spectrum  (DSSS),  frequency  band  at  2400  - 
2483.5  MHz,  3  channels  (simultaneous).  Carrier  Sense  Multiple  Access  with  CoUision 
Avoidance  (CSMA/CA),  11  Operating  Channels  (in  United  States).  The  wireless  Ethernet 
access  point  has  a  pubhshed  range  of  300  ft  in  an  unobstmcted  environment  at  11  Mbps 
and  100  ft  in  office  type  environments.  Ranges  at  1  Mbps  are  1000  ft  and  300  ft 
respectively.  This  access  point  if  purchased  separately  costs  $329.99.  (Xircom,  2001) 


Wir«le&&  Local  Ar«a  Network  (WLANt  Solutions 


CreditCard 

Wirelf&s.  Eth-ernet  SprirgPort  WirEless  Ethernel 

Adapter  WirEle-55  Etharnel  Pflint 

Figure  3.5.  Xircom  Wireless  Solution  (From  Xircom,  2001). 

d.  Symbol  Spectrum24  Access  Point  AP-3020 

AP-3021  is  currently  available.  Spectmni24  comphes  with  the  802.11 
standard  and  its  NetVision  phone  product  hne  employs  voice- over- IP  technology  that  is 
ITU  H.323  multimedia  standard  compliant.  It  supports  Wired  Equivalent  Privacy  (WFP) 
64  bit  encryption  and  decryption.  The  access  point  features;  data  rates  of  2  or  1  Mbps, 
Frequency  Hopping  Spread  spectmm  (FHSS)  transmission  operating  within  the  2.4  -  2.5 
GHz  band  with  79  hops  in  the  United  States,  CSMA/CA,  ranges  of  2,000  ft  in  open 
environments  at  1  Mbps  and  250  ft  in  office  type  environments  at  2Mbps.  AP-3021  is 
currently  available  at  a  cost  of  $1,495.00  and  the  PC  Card  adapter  costs  $395.00. 
(Symbol,  2001) 
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Figure  3.6.  Symbol  Wireless  Solution  (From  Symbol,  2001). 

D.  SOFTWARE 

The  medical  software  applications  utilized  in  this  study  can  be  broken  down  into 
five  distinct  categories.  They  are: 

•  Drug  Databases  -  They  are  electronic  dmg  references  that  provide  dosing, 
adverse  reactions,  dmg- to- dmg  interactions,  contraindications,  packaging 
and  pricing  information. 

•  Medical  Information  Databases  -  They  have  replaced  large  text  references 
containing  medical  diagnosis,  treatment  and  follow-up  information. 

•  Patient  Information  Databases  -  They  provide  access  to  patient  records, 
demographics,  reports  and  test  results  etc. 

•  Medical  Calculators  -  They  allow  numerous  formulas  and  clinical  scores 
to  be  rapidly  calculated. 

•  Patient  Billing  and  Coding  Databases  -  They  provide  Evaluation  and 
Management  (E&M),  Current  Procedures  Terminology  (CPT),  and 
International  Classification  of  Diseases  (ICD-9)  codes  required  for  billing 
purposes. 
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Several  Family  Practice  physician  reviews  of  the  numerous  apphcations  presently 
on  the  market  are  available  on  vendor  web  sites.  Identified  are  one  or  two  from  each 
category  that  met  our  criteria.  The  elements  comprising  the  criteria,  placed  in  order  of 
relevance,  are:  accuracy  of  medical  data  (patient  safety),  physician  acceptance  (ease-of- 
use),  compatibihty,  price,  and  apphcation  size.  Before  deploying  the  PDAs  with  the 
installed  medical  applications,  John  Luo,  M.D.,  Assistant  Chnical  Professor  at  the 
University  of  Cahfomia,  Davis  briefly  evaluated  the  apphcations  and  affirmed  the  value 
and  clinical  relevance.  However,  as  is  repeatedly  pointed  out  in  this  area  of  application 
integration,  they  are  in  no  way  a  replacement  for  sound  medical  judgment.  Dr.  Luo 
further  indicated  that  the  medical  residents  he  instmcts  are  provided  with  a  similar  set  of 
applications.  It  was  noted,  however,  that  several  medical  software  applications  require 
one  to  register  with  their  web  site,  download  a  trial  version,  e-mail  PDA  user  ID  and 
application  serial  number,  and  then  wait  2-4  business  days  to  receive  a  registration  code 
to  release  the  full  version.  The  majority  of  vendors  offer  free  trial  versions.  The 
applications  under  study  are  described  in  the  following  section: 

1.  Drug  Databases 

a.  ePocrates  qRx,  Version  3.0 

ePocrates  provides  chnicians  with  an  alphabetical  database  of  over  1,600 
dmgs.  A  collaborate  development  effort  among  physicians,  pharmacists,  and  software 
engineers  ensures  dmg  information  accuracy.  One  can  search  for  adult/pediatric  specific 
dosing,  adverse  reactions,  drug-to-drug  interactions,  contraindications,  pregnancy  and 
lactation  data,  receive  alerts  of  drug  recalls  etc.  and  automatic  database  updates.  Version 
4.0,  currently  available,  adds  packaging  and  pricing  information  and  other  features.  The 
OS  and  program  size  are  Pahn  only  and  under  900K,  respectively.  The  price  is  very 
attractive:  free.  Its  web  site  states,  "Physicians  using  qRx  have  already  avoided  thousands 
of  dmg  errors  based  on  a  recent  study  conducted  by  chnicians  at  Harvard  Medical 
School."  (ePocrates,  2001) 
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Drugs 


imiquimod  topical 

Imitrex 

Imodium 

Imuran 

Inapsine 

indapgmide _ 


Inderal 


Inderal  LA 
Inderide 
Inderide  Lfl 
indinavir 

Look  Up:  jnder .  (ByCloss) 


Inderal 


propranolol 

(10,20,40,60,80,90,  IV) _ 

hypertension 

[80-240  mg  PO  bid] 

Start:  40  mg  PO  bid,  increase  q3-7d; 
Max:  640  mg/d 

angina 

[80-120  mg  PO  bid] 

Info:  may  increase  dose  q7- 1 0d 


A  Rdult  Dosing  (  Back  )  ( Home  ) 


Inderal 


propranolol 

(10,20,40,60,80,90; IV) 

hypertension 


[80-240  mg  PO  bid] 

—  _  nzv  l:  j  : 

ncrease  q3-7d; 

Rdult  Do$inq 

Peds  Dosing 

Contraind/Caut. 

Drug  Interactions 

Adverse  Reactions 

;e  q7-10d 

Cost/Pkg  Info 

Other  Info 

Notes 

[  Back  ]  ( Home  ] 

Figure  3.7.  Screen  Captures  of  ePocrates  (From  ePocrates,  2001). 
b.  NursingDrugs,  2000 

NursingDmgs  by  Skyscape  presents  the  most  commonly  prescribed 
medications  in  a  user  friendly  and  easily  accessible  manner.  It  is  an  electronic 
representation  of  the  Lexi-Comp,  Incorporated  text,  Drug  Information  Handbook  for 
Nursing.  During  this  study,  NursingDmgs  was  replaced  at  Skyscape  by  DmgGuide 
(Davis  Dmg  Guide  for  Nurses),  version  4.0.5.  This  is  a  dmg  reference  containing  in 
excess  of  5,000  dmgs,  140  dmg  classifications,  700  dmg  combinations,  and  1,000  dmg 
monographs.  It  mns  on  either  Palm  OS  or  Pocket  PCAVindows  CE  and  its  program  sizes 
are  3.5  MB  and  8.2  MB  respectively.  A  trial  version  s  available  and  the  full  registered 
version’s  price  is  $49.95.  (Skyscape,  2001) 


Rbacavir  Sulfate 


Precautions'^ 


[Lactation]: 

HIV  infected  mothers  should  not 
breostfeed  their  infants. 

[Elderly]: 

Select  dose  with  caution,  reflecting 
greater  frequency  of  decreosed 
hepatic,  renal,  or  cardiac  function 
and  comorbidity, 
[Hypersensitivity]: 

Fatal  hypersensitivity  reactions 
have  been  associated  with 


flc 

flR 

J2. 

RD 

▲ 

I 


Figure  3.8.  Screen  Capture  of  DrugGuide  (From  Skyscape,  2001). 

2.  Medical  Information  Database 

a.  5-Minute  Clinical  Consult  2000 

This  apphcation  has  reduced  a  standard  aid  incredibly  large  text  reference 


for  medical  diagnosis  and  treatment  and  placed  it  in  the  pahn  of  a  single  hand.  It  features 
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in  excess  of  1,000  alphabetical  topics  and  593  expanded  topics  contributed  by  300 


clinicians.  It  provides  patient  diagnosis,  treatment,  medication,  and  foUow-up 
information.  The  OS  and  program  size  are  WinCE  at  5.2MB  and  Palm  at  1.987  to  2.8MB. 


The  price  is  $64.95.  (Skyscape,  2001) 


Hepatoma 


Medications 


hepatotoxicity 

Significant  possible  interactions: 
N/fl 

ALTERNATIVE  DRUGS 
■  Fluorouracil  (5-FU), 
cyclophosphamide,  methotrexate 
have  been  used  but  no  promising 
results  ■  Immunotherapy: 
Radiolabeled  antibodies  like 
131-l-antiferritin  have  been  used. 
Can  be  used  in  conjunction  with 


Figure  3.9.  Screen  Capture  of  5  Minute  Clinical  Consult  (From  Skyscape,  2001). 

3.  Patient  Billing  and  Coding 
a.  ICD-9  Notes 

This  application  is  a  searchable  database  using  key  words  or  3  digit  codes. 
It  contains  a  complete  set  of  over  15,000  ICD-9/CM  diagnosis  codes  and  can  be  tailored 
so  that  the  most  frequently  used  codes  are  on  top.  The  OS  and  program  size  are  Palm  OS 
and  under  321K,  respectively.  The  price  is  $20.00.  However,  its  web  site  is  mdimentary 
with  all  correspondence  restricted  to  e-mail,  (med- notes,  2001) 
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ICD-Notef  1.01 


Register  i  ? 


INFECTIOUS  SPflRflSITIC 


2  NEOPLASMS 

3  ENDO.NUTRISMETAB 

A  BLOOD  £  BLOOD  FORMING 
S  MENTAL 

i  NERVOUS  £  SENSE  ORGANS 

7  CIRCULATORY 

8  RESPIRATORY 
8  DIGESTIVE 

10  GENITOURINARY 

11  PREG.  BIRTH  £  PUERPERIUM 

12  SKINS  SUBCUTANEOUS  + 


Figure  3.10.  Screen  Capture  of  ICD-9  Notes  (From  med-notes,  2001). 

b.  TOPS  EM  Coder 

e-MDs'  TOPS  EM  Coder  handheld  application  was  released  in  October, 
2000.  It  calculates  the  correct  E&M  codes  and  identifies  missing  documentation  required 
to  reach  the  appropriate  E&M  level.  E-MD  provides  practice  management  (clinical  and 
financial)  tools  for  physicians  and  its  E&M  Coder  can  significandy  reduce  the  $60,000 
average  per  physician  of  lost  biUings  annually  in  the  United  States.  (Eisher,  2000) 

Tops  EM  Coder  mns  on  both  the  Palm  OS  and  Win  CE  and  is 
approximately  E9  MB.  The  price  is  $49.95.  (e-MDs,  2001) 

4.  Medical  Calculator 

a.  MedCalc 

With  66  formulas  and  chnical  scores  the  majority  of  which  have 
accompanying  references  and  clinical- use  hints  aU  hsted  in  alphabetical  order,  MedCalc 
is  a  favorite  among  physicians.  The  most  frequently  used  formulas  can  be  placed  in  a 
separate  category  and  patient  calculation  results  can  be  stored  in  a  database  file  on  your 
PDA. 

Some  calculations  that  might  be  performed  are  Apgar  score,  Bayes 
Theorem,  Oxygen  Index,  Pregnancy  due  date,  and  Vascular  Resistances.  The  OS  and 
program  size  are  Palm  and  under  193K  ,  respectively.  The  price  is  free.  (MedCalc,  2001) 
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1*3  topsE&M  Coder 


3:46p 


Number  of  Exam 
Items  Addressed 


12+ 


Detailed 


Exam 
Summary: 

Number  of  Diagnoses  or 
Management  Options 

Amount  or  Complexity 
of  Data  to  be  reviewed 


multiple 


moderate 


Risk  of  Complication  and/or 
Morbidity  or  Mortality 


moderate  ▼ 


Medical  Decision 
Making  Summary: 


Suggested 

Code: 


Moderate  Complexity 


Calculate  Code 


99214 


Documented 


Back 


Reset 


Exit 


eMDs  www.«-mds.conn 


Figure  3.11.  Screen  Capture  of  Tops  E&M  Coder  (From  e-MDs,  2001). 


1:29  prn 


MedCak 


Unfiled  I 


fill 


Infusion  management 


CD 


V  Formulas  and  scores : 


Growth  velocity 
Heort  rote  (EKG) 

Mender  son-Hosselbokh 
Hepatitis  discriminant  function 
Ideal  body  weight _ 


Infusion  manaqement 


Iron  deficit 
IV  drip  rate 
Kt/V  (PRU) 

LDL  cholesterol 
Likelihood  ratios 
Maintenance  IV  fluids  (ped.) 


Heparin 


Dose 


Dose :  400  ...  [[Uir  kg  /'[min] 

Et  Weight :  7.0 .  ▼  [kg] 

Solution :  .1.0000  [U] 

per  .1 . [mL]  of  fluid 


[  Reset )  (  Calculate  ] 
Infusion  rate  =  168 -w  [mL/h] 

(Back  to  main  menu) 


Figure  3.12.  Screen  Captures  of  MedCalc  on  Monochrome  Palm  OS  Device  (From 

MedCalc,  2001). 


b.  Archimedes 

70  Formulas  covering  a  broad  range  of  medical  specialties  are  listed 
alphabetically,  historically,  and  by  category  for  user  convenience.  It  has  a  buHt  in 
calculator  and  a  help  button  that  provides  detailed  information  on  each  formula. 

The  OS  and  program  size  are  WinCE  and  550k,  respectively.  The  price  is 
free.  (Skyscape,  2001) 
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5.  Patient  Information  Database 
a.  Patient  Tracker  4.1 

Patient  Tracker  is  a  patient  management  database  that  provides  access  to 
patient  records,  demographics,  reports  and  test  results.  It  can  automatically  generate 
progress  notes  to  include  lab  results,  vital  signs,  radiology  reports,  and  prior  patient  notes. 
It  also  has  the  capabihty  to  print  notes,  checkout  hsts,  and  patient  logs.  Version  5.1  adds 
password  protection  to  ensure  patient  privacy.  The  OS  and  program  size  for  is  WinCE 
and  348K  and  for  Palm  is  under  150K.  The  price  is  free.  (Handheldmed,  2001) 

E.  SAMPLE  CLINICAL  USE  OF  PDA  SOLUTION 

A  skeptical  manager  or  physician  might  ask,  “How  will  using  a  PDA  during  a 
patient  encounter  be  beneficial?”  The  answer  is  surprisingly  simple.  Utilizing  any  one  of 
the  PDAs  and  a  medical  software  apphcation  from  each  of  the  following  five  categories; 
dmg  databases,  medical  information  databases,  patient  information  databases,  medical 
calculators,  and  patient  biUing  and  coding  described  in  detail  in  this  study,  a  physician  in 
the  pahn  of  his/her  hand  could  perform  any  number  of  the  tasks  in  Table  3.4.  These 
business  and  chnical  efficiencies  can  be  integrated  into  virtually  any  physician  office, 
clinic,  hospital,  or  other  healthcare  organizations’  information  system  architecture  with 
relative  ease  and  at  minimal  cost. 


PDA  USE  DURING  A  PATIENT  ENCOUNTER 

1. 

View  daily  patient  schedules  on  a  standard  date  book  or  calendar 

2. 

Customize  an  address/phone  book  or  file  to  facilitate  patient 
referrals,  consults,  and  reference  local  pharmacy  information 

3. 

Search  a  drug  database  for  adult/pediatric  specific  dosing,  adverse 
reactions,  drug  interactions,  contraindications,  as  well  as  medication 
costs,  manufacturer,  and  packaging  details  resulting  in  the 
elimination  of  prescription  errors 

4. 

Reference  standard  medical  diagnosis  and  treatment  texts  to  locate 
uncommon,  rare,  or  forgotten  patient  diagnosis,  treatment, 
medication,  and  follow-up  information 

5. 

Access  patient  records,  demographics,  reports,  test  results  and  even 
generate  progress  notes  through  a  patient  management  database 

6. 

Perform  numerous  calculations  by  simply  tapping  on  a  formula  or 
clinical  score,  store  patient  results,  and  review  accompanying 
reference  or  help  sections  for  clinical-use  information; 

7. 

At  the  point-of-care,  accurately  identify  patient  billing  and  coding 
information  optimizing  revenue  collection. 

8. 

From  daily  downloads,  review  medical  journals,  be  alerted  of  drug 
recalls,  and  even  read  the  newspaper. 

Table  3.4.  PDAs  in  Practice. 
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F.  SUMMARY 

In  this  chapter  the  authors  detailed  why  NHL  was  selected  as  a  DoN  MTF  test  site 
at  which  to  employ  the  latest  technology  for  the  purpose  of  assessing  its  potential  within 
DoD  of  realizing  the  same  efficiencies  experienced  in  numerous  private  sector  healthcare 
organizations  as  well  as  generate  a  requirement  for  integration  within  MTF  information 
architectures.  This  chapter  also  explored  two  categories  of  hardware  installed  for  the 
purposes  of  this  study  at  NHL,  PDAs  and  wireless  interfaces.  The  PDAs  under  study  are: 
Pahn  Vx,  Symbol  SPT  1700,  Handspring  Visor  Platinum,  and  the  Compaq  Ipaq  3630. 
The  wireless  interfaces  include:  Xircom's  CreditCard  wireless  Ethernet  Adapter, 
SpringPort  Wireless  Ethernet  Module  and  wireless  Ethernet  Access  Point,  and  Symbol 
Technologies  Spectmni24  Access  Point  AP-3020. 

The  medical  software  apphcations  utihzed  in  this  study  by  category  detailed  in 
this  chapter  are:  the  Dmg  Databases,  ePocrates  qRx,  version  3.0,  and  Nursing  Dmgs;  a 
Medical  Information  Database,  5 -Minute  Chnical  Consult;  Patient  Billing  and  Coding, 
ICD-9  Notes  and  TOPS  EM  Coder;  and  Medical  Calculators,  MedCalc  and  Archimedes; 
Patient  Information  Database,  Patient  Tracker  4.1.  The  software  was  selected  based  on 
family  practice  physician  reviews  and  adherence  to  the  following  criteria:  accuracy  of 
medical  data  (patient  safety),  physician  acceptance  (ease- of- use),  compatibility,  price, 
and  apphcation  size.  This  chapter  also  offered  a  sample  of  how  a  physician  might  use  a 
PDA  during  a  patient  encounter. 
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IV.  BUSINESS  OPPORTUNITY 


A.  INTRODUCTION 

This  chapter  presents  the  Mihtary  Health  System's  (MHS)  vision  and  optimization 
team  mission.  In  support  of  that  mission  and  vision,  this  chapter  explores  the  benefits  of 
using  PDAs  and  wireless  technologies,  to  support  rapid  and  accurate  access  to  diagnostic 
and  biUing  information  using  case  study  success  stories.  Illustrated  are  the  lack  of 
consistent  high  data  quality  and  difficulties  of  provider  interaction  with  mihtary 
healthcare  information  systems.  In  addition,  this  chapter  shah  ihustrate  that  the  capturing 
of  missed  patient  encounters  enhances  revenue  generation  in  particular  lost  third  party 
revenue  and  reduces  medical  records  and  collection  personnel  labor  requirements.  This 
chapter  will  demonstrate  that  rapid  access  to  patient  data  on  a  PDA  is  possible  within  the 
DoD  Mihtary  Health  System,  in  particular  a  DoN  MTF. 

B.  THE  VISION  OF  THE  MILITARY  HEALTH  SYSTEM 

"The  MHS  is  responsive  and  accountable  to  DoD,  line  leadership,  and  our 
beneficiaries  by  providing  best  value  health  services  using  best  clinical  and  business 
practices."  (Mihtary  Health  System  Optimization,  2001)  To  meet  that  vision  MHS  has 
chartered  the  Mihtary  Health  System  Optimization  Team. 

1.  The  Military  Health  System  Optimization  Team  Mission 

"The  MHS'  success  depends  on  innovations  and  enterprise- wide  reengineering. 
The  Mihtary  Health  System  Optimization  Team  is  chartered  by  and  reports  to  MHS 
leadership  to  conduct  research,  coordinate  working  groups,  integrate  initiatives,  and 
recommend  strategies  and  operational  plans  to  achieve  the  MHS  vision."  (Mihtary 
Health  System  Optimization,  2001) 

2.  MHS  and  Managed  Care 

Managed  care  systems  are  ones  that  have  transitioned  from  the  traditional 
dehvery  model  of  fee- for- service  where  patients  pay  for  every  service  or  procedure  to 
one  of  capitation.  Capitation  caUs  for  the  payment  of  a  predetermined  annual  premium 
with  smaU  co-payments.  Ah  healthcare  services  have  to  be  provided  to  the  total 
beneficiary  population  using  that  finite  pool  of  resources.  This  philosophy  is  exactly  what 
is  driving  MHS's  vision  of  best  value  health  services.  TRICARE's  Management  Activity 
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(TMA)  Executive  Director,  James  Sears  in  a  press  release  states,  "The  conversion  of  the 
Mihtary  Health  System  to  a  managed  care  environment  has  created  the  need  to  adopt  new 
and  innovative  business  practices  that  are  data  driven."  (News  Release,  1999)  Also 
mentioned  in  the  release  is  the  need  for  accurate  data  collection  to  ensure  regulatory 
comphance  and  receive  Medicare  reimbursement. 

C.  MILITARY  ENTERPRISE  HEALTHCARE  INFORMATION  SYSTEMS 

The  TMA  data  quahty  team  estabhshed  to  enhance  TRICARE  patient  services 
will  first  examine  the  following  systems: 

1.  KG-ADS 

This  system  interfaces  with  CHCS  and  provides  a  pick  fist  of  diagnosis  and 
procedure  codes.  CHCS,  through  the  interface  known  as  the  Standard  Ambulatory  Data 
Record  (SADR)  Eog,  completes  the  ambulatory  patient  record  in  the  ADS  server.  The 
ADS  server  processes  the  patient  encounter  data  and  generates  the  Standard  Ambulatory 
Data  Record  (SADR).  The  SADR  is  transmitted  to  a  central  Department  of  Defense  data 
repository.  ADS  has  the  capability  to  locate  Composite  Health  Care  System  (CHCS) 
appointments  without  a  corresponding  ADS  record. 

2.  Composite  Health  Care  System  (CHCS) 

This  system  provides  ADS  with  patient  appointment  data  and  demographics, 
laboratory  and  chnical  test  results,  and  reference  data  required  for  batch  file  updates  and 
data  synchronization.  Evaluation  and  Management  (E&M),  Current  Procedures 
Terminology  (CPT),  and  International  Classification  of  Diseases  (ICD-9)  codes  are 
applied  to  patient  records  using  KG-ADS.  Current  Clinical  Information  Technology 
Program  Office  (CTTPO)  offerings  do  not  provide  smart  encoding  of  outpatient  records. 
Instead,  KG-ADS  was  developed  to  provide  a  method  to  look-up  codes. 

D.  WHY  EXAMINE  THESE  SYSTEMS  FIRST? 

I.  Charge  Capture  Difficulties 

At  the  commencement  of  this  study.  Naval  Hospital  Eemoore  experienced  in 
excess  of  2,000  KG-ADS  missed  patient  encounters  per  month.  Patient  encounter  data  is 
entered  into  ADS  via  steps  1  through  4  in  Table  4.1  to  recapture  these  encounters  include 
steps  5  through  10. 
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In  the  month  of  May,  after  heightened  scmtiny  the  delta  between  the  CHCS  visit 
workload  of  11,084  and  the  KG- ADS  visit  workload  of  10,686  was  398  indicating  a 
reduction  in  patient  encounter  losses  of  over  five  fold.  NHL  TPC  personnel  estimate  that 
this  number  will  be  further  reduced  to  200  within  two  months.  Once  identified  these 
encounters  can  stiU  be  coded,  closed,  reported  on  SADR  report,  and  subsequently  billed. 
However,  there  is  no  automated  means  of  verifying  the  completeness  of  KG- ADS  patient 
encounter.  Again,  this  presents  a  significant  obstacle  since  a  patient  could  have  multiple 
diagnoses  and  procedures  performed  and  documented  in  the  medical  record  but  only  the 
primary  diagnosis  code  entered  in  KG- ADS.  A  Quahty  Performance  Review  on  aU 
records  is  the  only  way  to  ascertain  any  discrepancies  and  medical  records  and  TPC 
personnel  must  then  perform  the  aforementioned  tasks. 

It  is  quite  evident  that  this  process  is  time  consuming,  redundant,  and  has  a 
negative  impact  on  billing  and  collection  efforts.  Improper  accounting  for  procedures 
adversely  affects  NHL's  budget  and  when  direct  care  records  are  incorrect  or  missing 
JCAHO  accreditation  is  jeopardized. 

2.  Why  are  Patient  Encounters  Partially  Completed  or  Missed? 

The  difficulty  begins  when  the  Provider  interacts  with  the  system.  Physicians 
describe  this  data  entry  process  as  antiquated,  requiring  excessive  screen  scrolls,  and  time 
consuming.  Time  they  add,  appropriately,  that  can  be  better  spent  on  patient  care.  The 
steps  necessary  for  a  Provider  to  complete  a  patient's  KG-ADS  file  are  illustrated  in 
Table  4.2.  These  steps,  depending  on  patient  complexity  can  require  10  to  16-i-  screen 
scrolls  and  take  up  to  5  minutes  for  physicians.  The  time  to  input  data  can  be  reduced  by 
ensuring  pick  hst  accuracy,  reducing  word  searches,  and  increasing  physician  proficiency 
with  the  system.  At  NHL,  Nurses  and  Hospital  Corpsman  input  this  data  more  frequently 
and  can  perform  the  tasks  more  rapidly  requiring  approximately  2  minutes  to  complete  a 
patient's  KG-ADS  record. 
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_ Outpatient  Charge  Captures _ 

_ Data  Entry _ 

1.  CHCS  provides  a  daily  download  to  ADS  for  the  next  day's  outpatient  appointments.  This 
takes  place  the  night  before  the  patient  encounters  scheduled  for  the  day,  and  occurs 

_ dynamically  if  walk-ins  or  new  appointments  occur  same-day. _ 

2.  Patient  encounter  codes  are  entered  into  KG-ADS. _ 

3.  That  data  is  transmitted  to  the  ADS  server  and  updates  the  ambulatory  patient  records  through 

ADSL _ 

4.  ADS  records  are  then  matched  to  CHCS  appointment  file.  At  this  point  third  party  collections 

_ (TPC)  personnel  can  identify  kept  appointments  without  an  ADS  record. _ 

_ Recapture  Efforts _ 

5.  TPC  personnel  request  third-party  extract  file.  The  rule  of  thumb  for  TPC  personnel  is  to  not 

_ take  ADS  as  the  only  document  to  bill  from. _ 

6.  When  in  doubt  about  an  entry  made  in  KG-ADS,  TPC  personnel  copy  the  CHCS/KG-ADS 

_ entry  and  e-mail  it  to  the  Physician  for  clarification. _ 

7.  Medical  records  then  locates  the  SF  600  for  review;  91%  of  the  time  according  to  Medical 

_ records  staff  at  NHL _ 

8.  After  the  SF-600  is  located  and  the  Physician  response  received,  complete  and  accurate  patient 
coding  data  necessary  for  reimbursement  is  now  entered  into  KG-ADS  usually  by  a  nurse  or 
Hospital  Corpsman. 

9.  Since  the  codes  have  now  changed,  TPC  personnel  must  re-run  the  third  party  extract  file 
before  it  can  be  loaded  into  the  Third  Party  Outpatient  Collection  System  (TPOCS),  which 

_ recoups  the  cost  of  providing  care  to  beneficiaries  with  third  party  insurance. _ 

10.  Claims  at  this  point  can  still  be  rejected  due  to  inaccurate  codes. _ 

Table  4. 1 .  Patient  Encounter  Data. 

_ Steps  To  Complete  A  Patient's  KG-ADS  File _ 

1 .  Sign  onto  CHCS _ 

2.  Select  KG  Ambulatory  Data  Systems  Option _ 

3.  Select  an  action  such  as  Physician  Management  Menu  (default) _ 

4.  Select  ADS  Data  Entry  Menu  Option _ 

5.  Select  Location  of  the  Clinic  (default) _ 

6.  Sele  ct  Provider  Name  (default) _ 

7.  Enter  Start  and  End  Dates  (default) _ 

8.  Select  Patient  Name _ 

9.  Select  Evaluation  and  Management  Code(s)  from  a  pick  list  of  75-90  codes  or  conduct  a  single 
or  partial  word  search. 

NOTE:  Providers  describe  this  functionality  as  wholly  insufficient.  Correctly  designed  pick 
_ lists  will  reduce  the  number  of  codes  to  choose  from  significantly. _ 

10.  Select  Diagnosis  Code  from  a  pick  list  or  word  search _ 

1 1 .  Rank  Diagnoses  in  order  of  significance _ 

12.  Enter  a  Procedure  Code  from  a  pick  list  or  word  search _ 

13.  Match  the  procedure  to  a  Diagnosis _ 

14.  If  a  procedure  was  not  performed,  the  Provider  selects  the  Pile  Option  and  completes  the 

_ record. _ 

15.  Update  the  Patient's  Master  Problem  Eist  with  new  diagnoses  (Optional) _ 

16.  Input  notes/comments  to  be  reviewed  by  other  Providers _ 

Table  4.2.  Provider  Interaction  (From  Ferguson,  2001). 
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E.  CANDIDATE  SOLUTIONS 

Looking  to  industry  benchmarks,  technological  advances,  and  traditional  business 
competencies  in  coding  and  reimbursement,  data  integration,  and  cost  management, 
potential  solutions  emerge.  These  solutions  utihze  PDA  technology  and  must  be 
accompanied  by  changes  in  management  and  provider  philosophies  as  well  as  sound 
pohcies  and  processes.  When  this  study  is  concluded,  the  hardware  and  software 
examined  wiU  already  be  dated.  The  pace  at  which  medically  related  hardware  and 
software  apphcations  are  being  developed  is  as  much  overwhelming  as  it  is  awe¬ 
inspiring.  The  W  R  Hambrect  &  Company  Industry  Report  predicts  that  twenty  percent 
of  physicians  wiU  use  a  PDA  in  chnical  practice  by  the  year  2004.  (Fisher,  2000) 

Management  must  reahze  that  harnessing  this  technology  for  physicians  requires 
redesigning  the  way  in  which  they  work  and  a  strong  commitment  to  its  use.  For  business 
competency  enhancements  to  begin  with  the  physician,  management  must  provide  them 
with  the  requisite  tools  and  training.  The  abihty  to  replace  scribbled  patient  notes  and 
reduces  the  amount  of  lost  patient  encounter  data  is  just  now  being  visuahzed  by 
physicians  as  a  clinical  tool  and  not  another  reason  to  change  the  way  they  do  things. 
Chapter  HI  of  this  study  provided  descriptions  of  patient  management  software  and 
patient  encounter  biUing  and  coding  software  that  can  accomphsh  just  that. 

I.  Success  Story:  Capturing  Charges  and  Increased  Bottom  Line 

The  following  synopsis  of  a  case  study  at  the  Department  of  Surgery  at  Brigham 
and  Women's  Hospital  details  the  benefits  these  new  programs  have  on  capturing  charges 
and  increasing  bottom  hnes.  This  study  focused  on  reducing;  the  number  of  lost  charges, 
write-offs  due  to  delayed  biUing,  processing  costs  for  denied  claims,  and  write-offs  due  to 
a  lack  of  authorization  for  service.  Its  goal  was  "clean  claim"  submission.  "Clean  claims 
are  those  that  are  not  rejected  as  unprocessable  due  to  inaccurate  or  missing  information." 
(pdaMD,  2001)  As  alluded  to  earher,  this  goal  must  begin  with  the  provider  and  more 
specifically  at  the  point-of-care.  The  Department  of  Surgery  prior  to  the  installation  of 
Mdeverywhere's  EveryCharge  system  experienced  lost  charges  at  a  rate  of  9.5  percent  of 
total  outpatient  visits.  The  study  reports  that  this  equates  to  $27,440  in  lost  revenue. 
Months  after  installation  of  the  system,  lost  charges  were  reduced  from  99  over  four 
months  to  only  ten  over  three  months.  The  study  indicated  that  with  continued  physician 
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education  regarding  the  systems  capabilities  that  that  number  could  be  reduced  to  zero. 
Claim  write-offs  resulting  from  exceeding  insurance  company  deadlines  for  submission 
are  all  too  common  in  healthcare.  The  study  correctly  points  out  that  a  majority  of  the 
delays  occur  while  collections  personnel  are  attempting  to  locate  supplementary  patient 
encounter  data.  The  Efepartment  of  Surgery  wrote  off  29  patient  encounters  at  a  cost  of 
$4,548:  a  direct  result  of  these  types  of  delays.  Following  the  EveryCharge  installation, 
days-to-post  claims  were  decreased  from  an  average  of  24.5  to  a  remarkable  7.9. 
EveryCharge  also  reduced  the  number  of  claims  written  off  resulting  from  no  prior 
authorization  for  service  being  obtained  or  obtained  incorrectly  saving  $2,834,  annually. 

To  address  the  reduction  of  administrative  costs,  EveryCharge's  customizable  mle 
engine  verifies  charge  accuracy  at  the  point- of- care  long  before  bill  submission.  It 
eliminates  the  need  to  reprocess  a  claim  saving  an  estimated  $25  per  claim.  (pdaMD, 
2001) 

2.  Another  Success  Story:  Increased  Charge  Capture  Rates 

Studies  conducted  at  the  HealthEirst  Medical  Group  in  Portland  Oregon  goals 
were  twofold.  Eirst,  utihzing  the  Hewlett  Packard's  620EX  Handheld  PC  with  the 
Windows  CE  2.1  OS,  to  track  physician  schedules,  procedures,  and  consultations. 
Second,  to  use  this  handheld  device  to  capture  and  transmit  patient  hiking  data  in  a 
manner  that  will  reduce  biUing  delays  and  improve  the  cost-effectiveness  of  the  process. 
The  results  indicated  no  significant  reduction  in  days-to-post  patient  encounter  charges. 
Hospital  charge  capture  rates  increased  dramatically  but  still  showed  a  three  percent  lost 
charge  rate.  Again,  physician  training  and  software  enhancements  are  required  to  reahze 
further  improvements.  The  number  of  consultative  charges  increased  by  157%  and  the 
charge  amounts  for  hospital  charges  increased  by  111%.  It  is  however,  worth  noting  that 
the  study  indicated  that  surgical  group  practice  did  experience  a  growth  rate  of  27% 
during  the  time  of  the  study.  (Blackman,  1999) 

F.  NAVAL  HOSPITAL  LEMOORE  PROOF  OF  CONCEPT 

This  proof  of  concept  will  demonstrate  that  rapid  access  to  patient  specific  data  by 
a  provider  on  a  PDA  is  plausible  within  the  DoD  Mihtary  Health  System,  in  particular  a 
DoN  MTE. 


32 


1.  A  Test  of  HL/7  Message  Data 

Broadening  the  scope  of  this  thesis  project,  Electronic  Data  Systems  (EDS) 
demonstrated  at  NHE  that  an  HE/7  interface  already  exists  between  CHCS  and  the 
Nutrition  Management  Information  System  (NMIS)  and  that  this  interface  could  be 
adapted  to  provide  patient  information  to  Microsoft  Outlook  at  which  point  a  provider 
could  download  the  data  to  a  calendar  on  a  PDA.  The  HE/7  interface  demonstration 
provided  patient  schedule  data  and  a  years  worth  of  pharmacy  and  laboratory  data  for 
outpatient  appointments  at  NHE.  NHE's  Eamily  Practice  physicians  were  receptive  to  the 
concept  of  having  patient  laboratory  and  pharmacy  data  in  their  PDA  calendars  days  in 
advance  allowing  time  for  review  and  conducting  research  on  any  questions  they  might 
have  regarding  the  patients'  history.  EDS,  the  authors  of  this  thesis,  and  the  physicians 
hypothesized  that  rapid  access  to  this  data  would  enhance  business  efficiencies  and  the 
quahty  of  patient  care.  Providing  a  production- ready  interface  of  this  type  at  other  Naval 
Hospitals  requires  the  completion  of  the  following  steps: 

•  Installation  of  a  Microsoft  Outlook  software  interface,  which  leverages 
NMIS's  capabihty  to  receive,  parse,  and  store  HE/7  message  data  sent 
from  CHCS. 

•  Acquire  and  install  an  NT  Server  at  NHE  to  host  the  software  interface, 
receive  HE/7  messages  from  CHCS,  and  estabhsh  a  connection  with  local 
mail  servers. 

•  Modify  the  CHCS  production  routine,  currently  available  only  for 
Nutrition  Management  chnics,  for  the  appropriate  outpatient  chnics. 
(White,  2001) 

The  physicians  hope  to  no  longer  be  delayed  by  lengthy  dumb  terminal  or 
desktops  PC  boot  ups  or  numerous  screen  interactions  to  locate  patient  data.  They  as 
with  other  aspects  of  this  study  are  enthusiastic  about  assessing  the  value  of  utihzing 
PDAs  to  interface  with  CHCS. 
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Direct  Post  to  User  Profile/Outlook 


Figure  4. 1 .  HL/7  Interface  (From  EDS,  2001). 


Unfortunately,  only  steps  one  and  two  were  accomplished  as  budget  restrictions 
and  lengthy  approval  procedures  impeded  the  accomplishment  of  step  c.  noted  above. 
These  budget  restrichons  and  approval  procedures  include  the  fohowing: 

•  The  CHCS  HL/7  message  rourine  was  hard  coded  with  NMIS  Medical 
Expense  and  Reporting  System  (MEPRS)  codes.  These  codes  afford 
consistent  reporting  of  personnel  workload,  obhgation  and  expense  data 
by  MTE.  Redeveloping  the  rourine  to  accept  a  dynamic  MEPRS 
designahon  and  test  the  routine  in  both  a  model  office  and  producrion 
environment  was  too  costly  for  this  study. 

•  Interface  definirions  undergo  a  rigorous  design  and  approval  review  to 
ensure  that  chnical  informahon  systems  whl  conhnue  to  operate  properly. 
Time  was  not  available  to  subject  the  interface  to  the  review  process. 

Einahy,  MHS,  TMA,  management,  and  physicians  must  see  the  chnical  and 
business  efficiencies  associated  of  having  this  patient  data  available  on  a  PDA  vice  a 
workstahon  in  each  examinahon  room. 
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2.  EDS  Business  Case 

In  a  draft  white  paper,  EDS  has  proposed  a  hybrid  solution  of  desktop 
workstations  and  PDAs  as  the  user  interface  platform  for  CHCS  H.  CHCSII  wiU  provide 
similar  outpatient  clinical  encounter  support  to  that  of  CHCS's  inpatient  chnical 
encounter  support  as  well  as  expand  capabihties  to  include  dental  patient  encounter  data. 
The  three  drivers  of  this  business  case  are  reduced  hfe  cycle  costs,  enhanced  productivity, 
and  deployment  with  the  latest  technology.  The  current  CHCS  n  deployment  plan  calls 
for  desktop  PCs  in  every  examination/treatment  room,  nursing  station,  and  physician 
office.  EDS's  hybrid  approach  would  significantly  reduce  the  $140  plus  miUion- dollar 
price  tag  for  EAN  upgrades  and  CHCS  n  desktop  workstations  as  well  as  allow  multiple 
access  methods.  It  details  three  different  user  scenarios  for  interfacing  with  CHCS  n. 
Eirst,  a  corpsman  may  require  a  fully  capable  desktop  PC  to  perform  administrative  tasks 
such  as  insurance  verification  and  patient  scheduling.  Second,  a  nurse  might  opt  for  a 
laptop  PC.  The  nurse  could  access  patient  specific  data  through  a  WEAN  connection.  The 
nurse  would  have  the  capabihty  to  generate  patient  notes  etc.  without  the  limitations  of 
pick  lists  and  review  nursing  dmg  information.  Third,  a  physician  may  choose  a  nimble 
and  compact  PDA  to  access  patient  data.  The  physician  could  document  the  patient 
encounter,  review  reference  material,  and  send  patient  orders  seamlessly.  This  paper 
outlines  business  process  efficiencies  such  as  increased  productivity  (more  time  spent 
with  patients)  that  have  bee  addressed  in  the  previous  chapters  of  this  study.  Through  the 
reduction  of  hfecycle  costs,  move/add/change  activity,  and  the  replacement  of  expensive 
CHCS  II  workstations/desktop  PCs  with  laptops  and  PDAs,  EDS  is  estimating  a  total 
savings  through  fiscal  year  2004  in  excess  of  $53  miUion- dollars.  (EDS,  2001) 

G.  SUMMARY 

Using  case  study  success  stories  conducted  at  the  Department  of  Surgery  at 
Brigham  and  Women's  Hospital  and  at  the  HealthEirst  Medical  Group,  this  chapter 
demonstrated  that  the  use  of  PDAs  and  wireless  technologies  does  streamhne  processes 
and  integrate  data  collection  and  information  retrieval.  Illustrated  was  the  fact  that  patient 
management  and  patient  encounter  billing  and  coding  software  can  provide  significant 
benefit  towards  capturing  charges  and  increasing  bottom  fines.  The  authors  of  this  study 
deduced  that  since  the  charge  capture  difficulties  experienced  at  NHE  are  not  dissimilar 
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to  other  healthcare  organizations.  NHL  should  then  realize  the  same  enhancements  and 
subsequent  increase  in  its  bottom  line  if  it  implements  a  system  that  allows  for  point-of- 
care  charge  capture  and  review.  A  test  of  an  existing  HL/7  interface  between  CHCS  and 
NMIS  provided  patient  information  to  Microsoft  Outlook  on  a  PDA  and  desktop.  This 
chapter  supports  MHS's  mission  and  vision  as  well  as  demonstrated  that  deployment  of 
accurate  and  complete  charge  capture  systems  is  possible. 
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V.  REQUIREMENTS  GENERATION  AND  ANALYSIS 


A.  INTRODUCTION 

In  this  chapter  the  authors  explain  the  development  and  issuance  of  the  User 
Requirement  Survey,  and  subsequent  analysis  and  presentation  of  the  survey  findings. 
The  processes  and  techniques  used  to  analyze  the  survey  data  submitted  by  users  are 
identified.  Next,  User  Requirement  Survey  respondent  demographics  are  presented.  This 
is  followed  by  the  online  User  Requirement  Survey  results.  Detailed  analyses  of  results 
are  provided  in  Appendices  A  through  C.  Finally,  the  Post-Testing  Phase  Out  Survey 
results  from  the  case  group  at  Naval  Hospital  Lemoore  are  presented. 

B.  USER  REQUIREMENT  SURVEY  DEVELOPMENT 

Several  methods  of  data  collection  were  used  in  this  study.  Primary  data  was 
collected  using  personal  interviews,  observation,  and  surveys.  Secondary  data  collection 
was  largely  comprised  of  hterature  research.  The  intent  of  this  study  is  that  the  resultant 
analysis  of  requirements  will  be  communicated  to  the  Information  Management, 
Technology,  and  Reengineering  Directorate  of  the  TRICARE  Management  Activity  for 
their  use  in  generating  DoD- level  user  requirements.  Early  coordination  with  this  team, 
as  well  as  others  hsted  in  Chapter  VIII:  Conclusions  and  Recommendations,  should 
greatly  assist  the  Department  of  Defense  with  developing  agency- wide  requirements  for 
the  use  of  PDAs  in  the  military  healthcare  environment. 

After  development  of  the  online  survey,  contact  was  next  made  with  either 
Executive  Officers,  Chief  Staff  Officers,  Chief  Information  Officers,  or  Command 
Webmasters  (or  their  equivalents)  from  major  facilities,  including  those  listed  below,  and 
asked  that  the  survey  be  promulgated  throughout  their  facihty  to  be  completed  on  a 
voluntary  basis: 

•  National  Naval  Medical  Center,  Bethesda 

•  Naval  Medical  Center,  San  Diego 

•  Naval  Medical  Center,  Portsmouth 

•  Tiipler  Army  Medical  Center,  Honolulu 

•  Madigan  Army  Medical  Center,  Tacoma 

•  Wihbrd  Hall  Medical  Center,  Eackland 
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•  Wright- Patterson  Medical  Center,  Dayton 

Some  facilities  provided  full  participation;  some  passed  the  request  to  selected 
areas  within  their  cognizance;  stiU  others  dechned  to  participate.  The  onhne  survey 
remained  open  for  several  weeks.  A  total  number  of  277  personnel  responded  to  the 
survey.  A  complete  version  of  the  online  survey  with  accompanying  response  totals  by 
position  can  be  found  in  Appendix  A.  Examples  of  the  visual  and  statistical 
representations  for  survey  responses  will  be  found  in  the  following  section.  Appendix  B 
provides  the  detailed  statistical  analyses  for  all  survey  responses. 

A  second  Post-Testing  Phase  Out  Survey  was  developed  for  the  participants 
assisting  with  hardware  and  software  assessment  at  the  Naval  Hospital  Lemoore.  That 
survey  population  consisted  of  eight  respondents:  one  Director  of  Chnical  Services,  five 
Family  Practice  providers,  and  two  Family  Practice  nursing  specialists.  Results  of  that 
survey  can  be  found  in  Section  E  of  this  chapter.  All  hardware  and  software  apphcations 
in  Section  E  have  been  discussed  in  detail  in  Chapter  III:  Operational  Eamiliarization. 

C.  PROCESSES  AND  TECHNIQUES 

The  final  iteration  of  the  User  Requirement  Survey  consisted  of  36  questions,  plus 
demographic  data  and  a  comments  section.  The  initial  survey  was  developed  locally  at 
the  Naval  Postgraduate  School,  with  its  question  content  drawn  upon  from: 

•  Fiterature  research 

•  Individual  interviews 

•  Personal  experience 

The  survey  was  created  using  an  interactive  format  and  placed  on  a  server  at  the 
Naval  Hospital  Femoore.  It  was  initially  tested  using  only  participants  from  that  Naval 
Hospital.  A  Delphi- group  round  table  among  Family  Practice  physicians  from  the 
facihty  was  conducted  in  order  to  ehcit  personal  comments,  reaction,  and  advice  with 
respect  to  survey.  All  feedback  from  the  round  table  session  was  incorporated  into  the 
final  version,  which  we  then  placed  on  a  website  hosted  at  the  Naval  Postgraduate 
School. 

1.  Data  Pre-Processing 

Data  pre-processing  consisted  of  two  tasks.  The  initial  survey  was  hosted  on  a 
website  at  NH  Femoore  and  issued  to  users  from  that  facihty  alone.  Based  upon  their 

38 


feedback  in  the  Delphi  roundtable  sessions,  the  survey  was  modified  to  reflect  several 
new  questions.  The  original  survey  data  was  assimilated  into  the  final  data  set.  This  will 
account  for  several  questions  not  having  the  quantity  of  responses  match  the  total  number 
of  respondents. 

The  second  task  involved  reviewing  every  response.  Some  respondents  felt  that 
they  were  not  quahfied  to  mark  certain  questions.  This  led  to  a  processing  error,  because 
by  survey  design  at  least  one  response  was  always  selected,  and  no  option  was  given  for 
Not  Applicable.  Where  respondents  identified  such  situations  in  their  comments  section, 
those  data  elements  were  removed  from  the  results.  Additionally,  the  survey  was 
screened  for  duplicate  entries,  of  which  several  were  found.  In  most  cases,  the  Comments 
section  of  the  data  reflected  a  statement  similar  to  “You  may  have  just  received  an  input 
from  me,  but  I  wanted  to  add  another  comment. . .  ”  Data  from  those  duphcate  submissions 
were  cleared. 

2.  Data  Conversion 

Data  conversion  consisted  of  coding  raw  responses  into  usable  data.  Coding  is 
defined  here  as  the  assignment  of  a  numerical  value  to  a  non- numeric  function.  For 
example,  the  majority  of  the  question  had  as  their  response  choices  High,  Medium,  and 
Low.  In  order  to  determine  statistical  values  such  as  mean  and  variance,  those  values 
were  given  weights  of  9,  5,  and  1,  respectively. 

3.  Data  Storage 

Data  storage,  while  conducting  the  survey,  consisted  of  maintaining  a  “hve” 
electronic  copy  of  the  Access  database  hosted  on  a  NFS  server.  Additionally,  daily 
backups  of  the  database  were  made  in  order  to  preserve  the  most  current  data  in  case  of 
catastrophic  loss.  Data  storage,  while  in  processing  (analysis),  was  performed  using  a 
combination  of  the  electronic  storage  method  (database),  additional  electronic  storage 
methods  (spreadsheets),  and  traditional  paper  copy  methods. 

4.  Processing 

The  processing  phase  of  this  section  contains  two  primary  themes: 
summarization  and  analysis.  The  summarization  of  data  is  presented  visually  using 
tables  and  charts.  The  summarization  also  extends  into  descriptive  statistical 
presentation.  Analysis  of  data  begins  with  the  descriptive  statistics  (those  that  define  the 
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observed  data  of  the  sample  population)  and  continues  with  the  inferential  analysis  (those 
which  can  be  used  to  make  predictions  about  the  entire  population). 
a.  Visual  Representation 

The  visual  representation  method  used  here  is  provided  as  the  initial 
means  for  interpretation  of  survey  data.  Tables  will  be  used  to  provide  numeric  counts, 
either  br  raw  data  or  for  data  segregated  by  categories.  Appendix  A  provides  the  reader 
with  a  complete  inventory  of  visually  represented  data  by  question  and  user  position. 


^  Position 

High 

Med 

Low 

1  CO/XO 

3 

3 

1 

Director  (DCS,  DEA,  DNS) 

1  16 

1  4 

1 

1 

Provider 

119 

36 

10 

Nursing  Specialist 

13 

6 

ComptroUer/BiHing/Claims 

1 

2 

1 

MIS  Head/CIO 

7 

2 

1 

Patient  Administration 

13 

6 

1 

Provider  Support  (Clinician) 

18 

9 

7 

Total: 

190 

68 

19 

277 

Table  5 . 1 .  Example  of  Raw  Data  Count. 


b.  Statistical  Representation 

In  order  to  better  represent  patterns  to  the  reader,  several  statistical 
methodologies  were  used.  The  methods  used  include  those  representing  descriptive 
statistics,  inferential  statistics,  and  hypothesis  testing.  While  some  descriptive  statistics 
given  in  the  appendices  are  not  used  in  hypothesis  testing  in  this  study,  they  are  compiled 
for  the  reader  for  their  own  use.  The  software  programs  used  to  compile  statistics  for  this 
study  are  Microsoft  Excel  2000  and  Prentice  Hall’s  PHStat  97  for  Excel.  Examples  are 
given  below 

(1)  Descriptive  (Weighted  Mean).  Descriptive  statistics  are 
those  methods  used  to  describe  values  of  a  sample  population.  Examples  would  be  the 
mode  (most  common  response)  median  (that  response  which  has  an  equal  number  of 
responses  above  and  below  in  value),  and  the  mean  (numeric  average  of  all  responses). 
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For  numerical  representation  of  High-Medium-Low  responses,  weights  of  9-5-1  were 
assigned,  respectively. 


Ql 

Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

204 

9 

1836 

Medium 

60 

5 

300 

Low 

18 

1 

18 

Total 

282 

2154 

7.61 

Table  5 .2.  Example  of  Weighted  Mean  Table. 

(2)  Descriptive  (Likert  Scale).  The  Likert  scale  can  be 
displayed  visually.  Lor  example,  the  blue  arrow  represents  a  high  value  and  the  gold 
arrow  represents  a  low  value. 


Ligure  5.1.  Example  of  Likert  Scale  Representation. 


(3)  Descriptive  (General). 


Descriptive  Statistics 

Mean 

8.292419 

Standard  Error 

0.096322 

Median 

9 

Mode 

9 

Standard  Deviation 

1.603115 

Sample  Variance 

2.569979 

Kurtosis 

3.134851 

Skewness 

-2.03753 

Range 

8 

Minimum 

1 

Maximum 

9 

Sum 

2297 

Count 

277 

Confidence  Level(95.0%) 

0.189619 

T able  5.3.  Example  of  Descriptive  Statistics . 
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(4)  Inferential  and  Hypothesis  Testing.  This  testing  wtil  define 
a  nuU  hypothesis  (Ho)  and  an  alternative  hypothesis  (Ha).  It  is  assumed  that  if  responses 
were  representative  of  a  random  distribution,  there  would  be  an  equal  number  of 
responses  per  category.  For  example,  if  90  people  responded  to  a  question  having  two 
answers,  yes  and  no,  it  would  be  expected  that  45  people  would  answer  yes  and  45  people 
would  answer  no.  A  Chi-Square  distribution  was  used  to  test  the  value  of  the  sample 
population.  The  nuU  hypothesis  for  responses  to  the  survey  is  H  :  There  is  no  statistical 
significance  for  a  user  preference  shown  among  response  categories.  If  the  Chi-Square 
test  shows  that  the  H.  should  be  rejected,  the  alternative  hypothesis:  H  must  be  accepted: 
There  is  statistical  significance  for  a  user  preference  shown  among  the  response 
categories. 


Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  1-3  scrolls  4-6  scrolls  7+  scrolls 

Total 

Actual  Count  230  45  2 

277 

Total  230  45  2 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  1-3  scrolls  4-6  scrolls  7+  scrolls 

Total 

Expected  Count  92.33  92.33  92.33 

216.% 

Total  92.33  92.33  92.33 

216.% 

Level  of  Significance 

0.05 

Number  of  Rows 

1 

Number  of  Columns 

3 

Degrees  of  Freedom 

2 

Critical  Value 

5.991476 

Chi-Square  Test  Statistic 

#NUM! 

At  the  .05  level  of  significance  we 

p-Value 

9.26E-70 

must  reject  the  nuU  hypothesis. 

Hq:  There  is  no  preference  shown 

Therefore,  there  appears  to  be  a 

Ha:  There  is  a  preference  shown 

preference  shown  favoring  high 

Reject  the  null  hypothesis 

user  value  in  this  area. 

Table  5.4.  Example  of  Chi-Square  Test. 


From  the  previous  example,  the  following  conclusions  were  made: 

Reject  the  nuU  hypothesis 

Accept,  at  the  .05  level  of  significance,  that  there  is  statistical  significance 
indicating  a  user  preference  in  the  response  category. 
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D.  ONLINE  USER  REQUIREMENT  SURVEY  DEMOGRAPHICS 
The  following  demographic  information  is  provided. 

•  Total  respondents:  277 

•  Respondents  by  service: 


Figure  5.2.  Respondents  by  Service. 


Respondents  by  position: 


□  CO/XO 

■  Director 

□  Provider 

□  Nursing  Speciaiist 

■  Comptroiler/Billing 

□  MIS  Head/CIO 

la  Patient  Administration 

□  Ciinician  Support 


Figure  5.3.  Respondents  by  Position. 

E.  ONLINE  USER  REQUIREMENT  SURVEY  RESULTS 

As  discussed,  the  survey  results  are  provided  in  several  formats.  Appendix  A  lists 
the  survey  questions  and  responses  by  position.  Appendix  B  lists  the  survey  responses 
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with  statistical  analysis.  Appendix  C  lists  the  survey  raw  data  responses  by  user  ID.  Note 
that  user  IDs  are  not  numbered  sequentially  from  1  to  277.  Several  ID  numbers  were 
used  in  the  development  of  the  survey,  while  numbers  missing  from  the  body  are  those 
that  were  processed  as  duphcate  entries.  The  following  table  also  provides  detailed 
survey  information  in  the  form  of  user- ranked  priorities  for  requirements.  The 
methodology  used  to  determine  rank  ordering  was  weighted  mean  of  responses  (refer  to 
Appendix  B  for  details).  This  table  should  provide  significant  input  in  the  determination 


of  user  requirements  with  respect  to  PDAs  in  the  mihtary  healthcare  clinic  environment. 


Rank 

value 

Rank -Ordered  User  Preferences 
(Weighted-mean  method) 

Question 

8.55 

The  value  of  a  portable  (pocket  sized)  PDA  is 

8.29 

The  number  of  acceptable  screen  interactions  (scrolls)  until  desired  information  is  located  is  (1-3  scrolls) 

8.22 

Q3 

The  value  of  using  PDAs  in  an  environment  where  a  wireless  connection  to  a  LAN  provides  continuous, 
real-time  data  is 

8.22 

BgE 

The  value  of  using  PDAs  to  reduce  medical  errors  (drug  interaction  warnings,  dosage  calculators,  etc)  is 

8.15 

Ba 

The  minimum  PDA  delay  in  screen  response  time  that  is  acceptable  is  (1-5  seconds) 

7.99 

B^ 

The  value  of  standardized  medical/business  applications  on  the  PDA  is 

7.92 

B^ 

The  value  of  accessing  patient  information  at  the  point  of  patient  care  with  a  PDA  is 

7.58 

BIE 

The  value  of  using  PDAs  for  personal  and  patient  scheduling  is 

7.58 

BB! 

The  value  of  medical  records  integration/access  with  a  PDA  is 

7.56 

BIE 

With  respect  to  PDAs,  limited  application  storage  (internal  RAM)  concerns  are 

7.56 

The  value  of  using  PDAs  to  look  up  1CD-9/CPT  /PDR  is 

7.48 

BIE 

The  value  of  using  PDAs  to  search  professional  literature  (e.g.,  AMA  abstracts,  Epocrates,  et  al)  is 

7.47 

Qi 

The  value  of  using  Personal  Digital  Assistant  technology  (Palm  Pilot,  Pocket  PC,  et  al)  to  input  data 
to/extract  data  from  the  Composite  Health  Care  System  and/or  the  Ambulatory  Data  System  is 

7.45 

The  value  of  using  PDAs  to  reduce/or  eliminate  KG-ADS  terminal  use  time  is 

7.34 

1^3 

The  value  of  using  PDAs  for  Radiological  Order  Entry  is 

7.27 

1^ 

The  value  of  using  PDAs  for  Laboratory  Order  Entry  is 

7.27 

iBa 

The  value  of  using  PDAs  for  Pharmaceutical  Order  Entry  is 

7.27 

IBIE 

With  respect  to  PDAs,  patient  privacy  (HIPAA)  concerns  are 

7.24 

IBIE 

With  respect  to  PDAs,  the  ability  to  personalize  content  are 

7.11 

IBIE 

With  respect  to  PDAs,  network  security  concerns  are 

7.01 

ISB 

With  respect  to  PDAs,  ease  of  use  concerns  are 

6.83 

iBm 

The  value  of  using  PDAs  for  e-mail  connectivity  is: 

6.70 

Q2 

The  value  of  using  PDAs  where  you  must  return  the  device  to  a  cradle  or  use  infrared  sync  station  to  update 
either  the  PDA  or  CHCS/ADS  is 

6.67 

Q35 

The  value  of  integrating  barcode  scanning  capability  (match  medications  with  patient,  associate  material 
costs  with  episodes  of  care/inventory  control)  on  the  PDA  is 

6.48 

IB^ 

The  value  of  integrating  voice  transcription  services  on  the  PDA  is 

6.46 

iBai 

With  respect  to  PDAs,  additional  functionality  (use  as  a  voice  recorder,  beeper,  etc.)  is 

6.42 

IBa 

The  value  of  using  PDAs  to  provide  billing  info  directly  to  billing  dept  is 

6.36 

IBa 

The  value  of  point -of-service  patient  registration/admission  with  the  PDA  is 

6.17 

1^ 

The  value  of  providing  an  audio  alert  for  high-priority  e-mail  on  the  PDA  is 

5.53 

IBa 

The  value  of  utilizing  medical  imaging  (low-level  diagnostic  display  capability)  on  the  PDA  is 

5.48 

IBIB 

With  respect  to  PDAs,  cost  concerns  are 

With  respect  to  PDAs,  a  color  display  is  important 

T able  5.5.  Rank-  Ordered  User  Preferences  for  Requirements . 
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F.  POST-TESTING  PHASE-OUT  SURVEY 

Recall  that  the  operational  phase  of  this  research  was  to  gain  provider  perspective 
with  respect  to  hardware  and  software  apphcations.  This  was  accomplished  via  a 
partnership  with  the  Naval  Hospital  Lemoore,  whereby  the  Family  Practice  Department 
agreed  to  assist  in  evaluating  product  characteristics  to  determine  desired  functionahty 
with  respect  to  requirements  evaluation.  The  participants  were  given  three  matrices,  with 
selections  for  High,  Medium,  or  Low  value.  Again,  for  numerical  purposes  the  values,  9, 
5,  and  1  respectively  were  assigned  to  derive  a  weighted- mean  value.  The  respondent 
demographics  and  survey  responses  are  provided  in  the  remainder  of  this  section. 

1.  Demographics 


Rank 

Ouantitv 

01-03 

5 

04  or  above 

3 

Table  5.6.  Out  Survey  Respondents  by  Rank. 


Position 

Ouantitv 

Director 

1 

Family  Practice  Physician 

5 

1  Family  Practice  Nurse  II  2  1 

Table  5.7.  Out  Survey  Respondents  by  Position. 

2.  Software  Evaluation 


Medical  Applications 

Coding 

Patient 

Tracking 

Drug  Databases 

Diagnosis 
&  Treatment 

Medical  Calculators 

ICD-9 

Notes 

Patient 

Tracker 

4.1 

EPocrates 

Nursing 

Drugs 

Five  minute 
Clinical 
Consult 

MedCalc 

Archimedes 

Ease  of  use 

7.25 

6.33 

7.50 

7.00 

9.00 

8.33 

5.00 

Readability  of 
graphics/text 

9.00 

7.66 

8.00 

7.00 

7.66 

7.66 

5.00 

Program  navigation/ 
responsiveness 

7.25 

7.66 

7.50 

7.00 

9.00 

8.33 

6.33 

Accuracy  of  medical  data 

9.00 

7.00 

8.00 

7.00 

9.00 

8.33 

6.33 

Program  reliability 
(buggy  software) 

7.25 

7.66 

8.00 

7.00 

9.00 

9.00 

6.33 

Medical  value 

6.00 

6.00 

9.00 

7.00 

9.00 

9.00 

7.66 

Help/Service/Support 

5.00 

7.00 

7.14 

7.00 

9.00 

6.30 

6.33 

Prosram  customizabilitv 

3.00 

7.00 

5.00 

7.00 

5.00 

5.00 

7.00 

Total 

53.75 

56.31 

60.14 

56 

66.66 

61.95 

49.98 

Weiehted  mean 

6.72 

7.04 

7.52 

7 

8.33 

7.74 

6.25 

Table  5.8. 


Evaluation  of  Medical  Apphcations. 
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In  Figure  5.4,  the  medical  applications  are  displayed  in  a  visual  format  for  ease  of 
understanding. 


Figure  5.4.  Likert  Scale  Plot  of  Medical  Applications. 


3.  Hardware  Evaluation 


PDA  Platforms 

Palm  Vx 

Handspring  Visor 

Compaq  iPAQ 
Pocket  PC 

Symbol  SPT  1700 

Desktop  Software 

8.20 

9.00 

9.00 

7.66 

Operating  System 

8.20 

9.00 

9.00 

9.00 

Memory 

4.20 

7.00 

9.00 

5.00 

Display 

6.60 

8.00 

9.00 

7.66 

Battery  Life 

7.40 

4.00 

7.00 

6.33 

Portability 

Size/weight 

7.40 

6.00 

5.00 

3.66 

Expandability 

3.40 

7.00 

9.00 

5.00 

Connectiyity 

5.00 

5.00 

9.00 

6.33 

Ruggedness/ 

Suryiyability 

5.00 

5.00 

5.00 

9.00 

Ergonomic  design 

6.60 

6.00 

5.00 

5.00 

Total 

62 

66 

76 

64.64 

Weighted  mean 

6.2 

6.6 

7.6 

6.46 

Table  5.9.  Evaluation  of  Hardware  Platforms. 

In  Figure  5.5,  the  hardware  platforms  are  displayed  in  a  visual  format  for  ease  of 
understanding. 


1  2  3  4  5  f  T  (;  3 

Figure  5.5.  Likert  Scale  Plot  of  Hardware  Platforms. 

G.  SUMMARY 

This  chapter  explained  the  methodologies  used  to  collect,  analyze,  and  display 
data  for  generation  of  PDA  requirements  in  the  mihtary  healthcare  clinic  environment. 
Surveys  were  developed  and  posted;  data,  both  demographic  and  survey  specific,  was 
then  collated  and  analyzed  using  both  graphical  imaging  and  statistical  analyses. 


46 


Detailed  responses  were  given  in  Tables  6.5,  6.8,  6.9  and  Appendices  A  through  C. 
Recommendations  based  on  the  analyses  are  given  in  Chapter  VIII:  Conclusions  and 
Recommendations. 


47 


THIS  PAGE  INTENTIONALLY  LEET  BLANK 


48 


VI.  WIRELESS  NETWORKING  TECHNOLOGIES 


A.  INTRODUCTION 

In  this  chapter  the  authors  provide  a  brief  PDA  technology  background  followed 
by  an  overview  of  wireless  technologies.  Those  technologies  include  detailed  Bluetooth, 
Infrared,  Frequency- Hopping  Spread  Spectrum  (FHSS)  and  Direct- Sequence  Spread 
Spectmm  (DSSS).  An  empirical  presentation  of  an  IHSS  and  a  DSSS  wireless  solution 
is  provided.  Finally,  a  glimpse  into  future  wireless  apphcations,  including  Coded 
Orthogonal  Frequency  Division  Multiplexing  (COFDM),  is  provided.  A  visual  overview 
of  this  chapter  is  presented  in  the  following  table. 


Wireless  Technologies 

Section  B 

Technology  Background 

Section  C 

Bluetooth 

Section  C.l 

Parameters 

Section  C.2 

Usage  Models 

Section  C.3 

Medical  Advancements 

Section  D 

Infrared 

Section  D.l 

Parameters 

Section  D. 2 

Support 

Section  E 

Spread  Spectrum  Technologies 

Section  E.  1 

Erequency- Hopping  Spread  Spectmm 

Section  E.2 

Direct- Sequencing  Spread  Spectmm 

Section  E 

An  Empirical  Comparison  of  Products 

Section  G 

Euture  Apphcations 

Table  6 . 1 .  Chapter  VI  Overview . 

B.  TECHNOLOGY  BACKGROUND 

The  prohferation  of  Personal  Digital  Assistants  (PDAs),  and  the  widespread 
progress  in  mobile/wireless  technologies,  has  made  available  for  several  years  the 
opportunity  for  improving  business  practices  across  industries.  As  discussed  earlier,  one 
sector  of  the  market  that  has  taken  particular  advantage  is  healthcare.  Major  healthcare 
facihties/groups  ideally  centralize  personal  patient  healthcare  and  billing  data  into  one,  or 
possibly  two,  interconnected  information  systems  (hereafter  described  as  enterprise 
systems). 
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Commercial- olf- the- shelf  (COTS)  software  apphcations  exist  which  integrate 
seamlessly  with  these  enterprise  systems  and  allow  for  functionahty  such  as  physician 
order  entry  (e.g.,  ordering  laboratory  or  radiological  studies,  or  entering  a  personal 
prescription  into  the  system).  As  shown  in  Chapters  I,  n  and  IH  these  apphcations  can 
also  provide  for  patient  scheduling,  mobile  access  to  patient  data,  and  medical  guidance 
on  critical  paths  to  patient  care.  These  tools  can  reduce  medical/prescription  errors,  make 
accurate  connections  between  treatment  plans  and  patient  biUing,  properly  assign  medical 
material  costs,  and  make  adjustments  to  material  inventories,  thus  triggering  automatic 
reordering  processes.  These  improvements  to  patient  care  have  a  synergistic  effect  when 
operated  in  a  real-time  wireless  environment.  While  the  commercial  healthcare  sector 
has  been  investigating  potential  benefits  and  developing  solutions  for  several  years,  the 
mihtary  has  yet  to  formaUy  assess  requirements  in  this  area  at  either  the  Department  of 
Defense  (DoD)  or  component  level. 

Several  wireless  technologies  available  today  standout  when  discussing  use  over  a 
Local  Area  Network  (LAN).  These  hclude  Bluetooth,  Infrared,  and  RF  wireless  LAN 
(both  802.11  and  802.11b).  While  this  study  emphasized  the  use  of  the  latter,  the  former 
bear  at  least  cursory  discussion  here  as  their  use  in  medical  facihties  becomes  more 
common.  Private  sector  success  stories  utilizing  mobile  platforms  with  wireless 
connections  abound.  The  Chicago-based  Midwest  Heart  Speciahst  cardiology  group,  for 
example,  has  been  using  the  Proxim  RangeLAN  solution  for  several  years  (Levine, 
2000).  The  practice  has  installed  five  wireless  access  points  in  four  offices.  Each  of  the 
three  single-story  offices  has  one  access  point,  while  the  two-story  facihty  has  one  on 
each  floor.  The  group  uses  60  handheld  Sharp  wireless  devices  to  seamlessly  transmit 
medical  data  between  the  units  and  their  wired  networks 
C.  BLUETOOTH 

In  1994,  Ericsson  Mobile  Communications  began  a  study  that  was  to  explore  the 
feasibihty  of  a  short-range,  low-powered,  low-cost  solution  that  would  allow  cellular 
telephones  to  connect  with  their  peripherals.  The  result  was  Bluetooth,  an  RF  wireless 
technology  developed  for  local  area  voice  and  data  communication  by  a  Special  Interest 
Group  (SIG)  consortium  of  leading  technology  companies.  The  group  now  numbers  in 
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excess  of  1300  members,  and  includes  industry  leaders  such  as  IBM,  Intel,  Microsoft, 
Lucent,  Motorola,  Nokia,  Toshiba,  Ericsson  and  3Com. 

1.  Parameters 

The  system  operates  in  the  2.4  GHz  ISM  (Industrial,  Scientific,  Medical)  band, 
providing  hcense-free  operation  in  the  United  States,  Europe,  and  Japan.  The  hardware  is 
based  on  a  9mm  x  9mm  RE  microchip  that  provides  up  to  a  10- meter  range.  The  range 
can  be  extended  to  up  to  100  meters  with  amphfiers.  The  technology  also  includes  an 
open  standard  adaptive  protocol  that  controls  connections,  sessions,  and  security. 
Bluetooth  technology  is  fast  becoming  synonymous  with  the  phrase  Wireless  Personal 
Area  Network  (WPAN),  or  the  IEEE  802.15  standard.  Bluetooth-enabled  devices  can 
form  piconetworks  by  Unking  with  up  to  seven  other  Bluetooth  enabled  devices  that  are 
within  range. 

The  Bluetooth  Specification  is  a  de  facto  standard  containing  the  information 
required  to  ensure  that  diverse  devices  supporting  the  Bluetooth  wireless  technology  can 
communicate  with  each  other  worldwide.  The  document  is  divided  into  two  parts: 

•  Volume  1  (Core) 

•  Volume  2  (Profiles) 

The  Core  section  specifies  components  such  as  the  radio,  baseband,  Unk  manager, 
service  discovery  protocol,  transport  layer,  and  interoperabiUty  with  different 
communication  protocols.  The  Profiles  volume  specifies  the  protocols  and  procedures 
required  for  different  types  of  Bluetooth  appUcations.  Bluetooth  wiU  support  three 
synchronous  64  kbps  voice  connections  and  a  721  kbps  bi-directional  or  a  56  kbps  one¬ 
way  multimedia  connection. 

2.  Usage  Models 

The  Bluetooth  Special  Interest  Group  has  identified  potential  usage  models. 
Some  of  the  more  appUcable  models  are  fisted  in  the  following  table. 
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Bluetooth  Usage  Models 

1. 

A  phone  functions  as  a  portable  phone  (fixed  line  charge)  while  at  home.  Wien  on 
move,  it  functions  as  a  mobile  phone  (cellular  charge).  When  the  phone  comes  w 
range  of  another  mobile  phone  with  built-in  Bluetooth  wireless  technology  it  func 
as  a  walkie-talkie  (no  telephony  charge). 

2. 

Real-time  internet  access  is  provided  on  a  mobile  computer  regardless  of  loca 
using  Bluetooth  connections  through  a  mobile  phone  (cellular)  or  through  a  prox 
wired  access  point  (e.g.  PSTN,  ISDN,  FAN,  xDSE). 

3. 

In  meetings  and  conferences,  selected  documents  can  be  instantly  transferred 
participants,  and  exchange  of  electronic  business  cards  occurs  automatically. 

4. 

Wireless  headset  connection  to  a  mobile  phone,  mobile  computer  or  any  v 
connection  keeps  hands  free  for  more  important  tasks  when  at  the  office  or  in  a  car. 

5. 

Automatic  synchronization  of  a  desktop,  mobile  computer,  notebook  (PC- PDA  and 
HPC)  and  mobile  phone  is  achieved.  For  instance,  as  soon  as  a  personal  offic 
entered  the  address  fist  and  calendar  on  a  notebook  will  automatically  be  updatei 
agree  with  the  one  on  a  desktop,  or  vice  versa. 

Table  6.2.  Examples  of  Bluetooth  Usage  Models. 

3.  Medical  Advancements 

A  specific  advancement  of  Bluetooth  technology  in  the  medical  arena  is  the 
development  of  the  “Smart  Shirt”  (Wolf,  2000).  Originally  funded  by  the  Defense 
Advanced  Research  Projects  Agency,  the  intent  was  to  provide  a  monitoring  unit  with 
transmitted  vital  biologic  statistics  of  the  soldier  in  the  field.  In  that  way,  triage- like 
determinations  could  be  made  that  could  help  shape  any  rescue  attempts.  The  Georgia 
Institute  of  Technology’s  School  Textile  and  Fiber  Engineering  developed  the  fabric  used 
in  the  tee  shirt,  which  is  woven  with  conductive  fibers. 
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The  Smart 
Schematic 


Electrical  CorxIiKting 
Comporvent 


Optical  Sensing 
Component 


Form-Fitting 

Component 


Static  Dissipating 
Component 


Comfort  Component 


Figure  6.1.  The  Smart  Shirt  Fabric  Model  (From  Wolf,  2000). 


Micro- sensors  transmit  the  medical  data  using  Bluetooth  technology  to  802.11- 
based  transceivers  carried  by  the  individual.  Those  signals  are  then  transmitted  to  the 
appropriate  monitoring  units.  The  shirts  are  now  being  used  in  some  neo- natal  intensive 
care  units  to  provide  vital  signs  monitoring  of  premature  infants. 


Figure  6.2.  A  Smart  Shirt  Monitoring  a  Premature  Infant’s  Vital  Signs  (From  Wolf, 

2000). 
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Figure  6.3.  Overview  of  Smart  Shirt  Technology  (From  Wolf,  2000). 


The  commercial  deployment  of  Bluetooth- enabled  devices  is  only  now  beginning. 
The  potential  exists  for  healthcare  providers  to  reduce  the  current  time  spent  on  logging 
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in  to  multiple  devices  and  synchronizing  the  data  between  them,  thus  freeing  them  from 
routine  administrative  tasks  to  perform  clinical  functions.  It  will  take  a  few  years  to 
determine  its  impact  and  acceptance  in  the  healthcare  industry  as  a  wireless  technology. 

D.  INFRARED 

Infrared  (IR)  communications  is  based  on  technology  that  is  similar  to  the  remote 
control  devices  such  as  TV  and  entertainment  remote  controls  used  in  most  homes  today. 
IR  offers  a  convenient,  inexpensive  and  rehable  way  to  connect  computer  and  peripheral 
devices  without  the  use  of  cables.  In  1993,  the  Infrared  Data  Association  (IrDA,  2001),  a 
non-profit  organization,  was  founded  in  Walnut  Creek,  CA  to  promote  global  IR 
Standards.  Today,  IrDA  connectivity  is  routinely  incorporated  into  portable  devices  to 
bring  us  the  most  cost-effective  and  easy-to-use  support  available  for  wireless 
technologies.  There  are  few  US,  European  or  other  international  regulatory  constraints. 
Manufacturers  can  ship  IrDA-enabled  products  globally  without  any  constraints,  and 
international  travelers  can  use  IrDA  functional  devices  wherever  they  are.  Environmental 
interference  problems  are  minimal  with  this  technology,  however  unobstmcted  line-of- 
sight  transmission  is  a  requirement  (DeJesus,  1998).  This  is  not  the  same  as  direct  hne- 
of- sight.  Distant  connectivity  has  been  estabhshed  with  IrDA  systems  using  holographic 
diffraction  gratings  (mirrors)  as  a  method  of  bypassing  physical  obstmctions  such  as 
hallway  comers.  This  is  usually  only  useful  in  an  internal  environment,  as  inclement 
weather  can  inhibit  infrared  transmissions  of  this  nature. 


I 

I 


Eigure  6.4.  A  Concave  Holographic  Diffraction  Grating  (Erom,  Agilent,  2001). 
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1.  Parameters 

IrDA  has  a  developed  set  of  standards  for  interoperable  IR  data  communications. 
In  1993,  IrDA  determined  the  basis  for  the  Serial  Infrared  (SIR)  Data  Link  Standards 
(Millar,  1998).  In  June  1994,  IrDA  pubhshed  the  standards  that  include  (SIR)  Link 
specification.  Link  Access  Protocol  (LAP)  specification,  and  Link  Management  Protocol 
(LMP)  specification.  They  released  extensions  to  SIR  standard  including  4Mb/S  in 
October  1995.  The  IrDA  Standard  Specification  has  been  expanded  to  include  high-speed 
extensions  from  1.152  Mb/S,  4.0  Mb/S  and  16  Mb/S.  This  extension  requires  an  add-in 
card  to  retrofit  legacy  PC's  with  high  speed  IR,  and  a  synchronous  communications 
controller  or  equivalent.  The  standard  is  now  divided  into  two  major  categories:  data  and 
control  (IrDA  Standards  2001).  IrDA  data  defines  the  standard  for  two-way  data 
interchange  using  the  infrared  medium  for  transmission  between  data  ports.  IrDA 
Control  (IrDA-C,  formerly  known  as  IrBUS)  defines  the  standard  that  allows  peripherals 
to  interact  with  intelhgent  host  devices.  These  include  keyboards,  mice,  joysticks,  and 
pointing  devices.  IrDA-C  is  a  PC-peripheral  style  bus  protocol,  and  does  not  interfere 
with  the  application  developer  (Microsoft,  2001).  The  protocol  is  low  speed,  low  latency, 
long  distance  (6  meters),  wide  angle,  and  multiple- device  enabled.  Multiple  devices  are 
enabled  hrough  a  dithering  scheme  that  is  a  form  of  Packet  Reservation  Multiple  Access 
(PRMA)  technology. 

2.  Support 

In  1995,  several  market  leaders  announced/released  products  with  IR  features 
based  on  IrDA  standards.  These  products  included  adapters,  printers,  PC's,  PDA's, 
notebook  computers,  LAN  access  devices,  and  software  applications.  In  November  1995, 
Microsoft  Corporation  first  announced  it  had  added  support  for  IrDA  connectivity  to  the 
Microsoft  Windows  95  operating  system,  enabhng  low-cost  wireless  connectivity 
between  Windows  95  based  PC's  and  peripheral  devices  (Microsoft,  2001).  That  support 
has  continued  through  to  their  latest  operating  systems  iteration,  Windows  2000  and 
Windows  XP.  Windows  2000  is  the  first  NT-based  operating  system  to  incorporate  IrDA 
protocols,  providing  support  for  IrNET  and  IrDial.  Windows  XP  further  integrates  the 
technology  by  providing  support  for  those  plus  IrCOMM. 
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E.  SPREAD  SPECTRUM  (SS)  TECHNOLOGffiS 

Spread  Spectrum  (SS)  technology,  also  referred  to  as  Code- Division  Multiple 
Access  (CDMA),  takes  a  conventional  narrow-band  signal  and  transmits  it  across  a 
broader  frequency  spectmm  in  one  of  several  ways.  A  SS  signal  bandwidth  is  much 
greater  than  the  message  bandwidth,  with  the  information  bandwidth  being  20  to  254 
times  larger  for  commercial  systems,  and  up  to  1000  times  as  large  for  some  mihtary 
apphcations.  SS  technology  is  achieved  in  a  variety  of  methods.  Common  to  both  of  the 
following  technologies,  an  Access  Point  or  wireless  LAN  transceiver  functions  in  effect 
as  a  bridge,  connecting  802.3  Ethernet  to  802.11(b).  The  typical  range  of  an  Access 
Point  varies  from  20  to  500  meters,  dependent  upon  such  factors  as  transmitted  power, 
antenna  configuration,  and  stmctural  interference.  Actress  Hedy  Lamarr  and  composer 
George  Antheil  devised  and  patented  the  technology  in  1942  (Macdonald,  1992). 


Figure  6.5.  Sketches  Submitted  by  Hedy  Lamarr  and  George  Antheil  Supporting  their 
Frequency  Hopping  Technology  Patent  in  1942  (From  Hoglund,  2001). 


Their  vision  was  that  the  U.S.  Navy  in  World  War  n  would  be  able  to  control  our 
torpedoes  using  a  radio  frequency,  and  that  by  “hopping”  the  frequency,  transmission 
would  be  provided  against  unwanted  interception.  It  was  not  used  by  the  US  mihtary. 
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however,  until  1962,  during  the  Cuban  missile  crises.  This  was  three  years  after  the 
patent  had  expired. 

1.  Frequency-Hopping  Spread  Spectrum  (FHSS) 

FHSS  “hops”  the  narrow-band  transmission  signal  across  the  broad  transmission 
band  as  a  function  of  time.  Standard  narrow-band  radio  transmissions  are  susceptible  to 
interference  from  adjacent  frequencies.  With  an  FHSS  solution,  that  type  of  spatial 
interference  is  effectively  negated  because  the  frequency  of  the  carrier  is  constantly 
shifting.  Additionally,  since  the  Spread  Spechum  signals  are  spread  so  widely  across  a 
broad  transmit  band,  the  necessary  transmit  power  level  is  less  than  required  for  standard 
narrow-band  transmissions.  Recalling  the  mathematical  postulation  of  C.  E.  Shannon 
(Fitzummons,  1997): 

Shannon’s  Law: 

C  =  Wlog(l-rS/N) 

where  C  is  Channel  capacity,  W  is  Bandwidth,  and  S/N  is  the  ratio  of  signal  power  to 
noise  power.  By  increasing  bandwidth,  system  signal  power  requirements  are  reduced. 
The  graph  below  demonstrates  another  representation  of  the  same  principle. 


Noise  Level 


Figure  6.6.  Comparison  of  Spread  Spectrum  and  Narrow  Band  Waveforms  (From 

Fitzummons,  1997). 

For  FHSS,  the  transmitter  and  receiver  share  a  code  that  determines  where  (at 


what  frequency)  the  carrier  will  be  at  any  given  time.  The  code  synchronizes  both 
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devices  so  that  they  hop  in  unison.  The  technology  utilizes  66  different  hopping  patterns, 
and  the  frequency-hopping  rate  is  very  high,  with  the  signal  remaining  on  a  specific 
frequency  for  less  than  10  milliseconds.  These  are  all  critical  for  anti-jarnming/Lowest 
PossibUity  of  Detection  (LPD)  characteristics  desired  in  both  mihtary  and  sensitive 
private- sector  systems. 

FHSS  is  governed  by  the  IEEE  802.11  industry  standard.  The  standard  defines 
three  physical  layer  methods,  EHSS  and  DSSS  using  RE,  and  the  third  using  infrared 
technology.  The  two  RE  layers  operate  in  the  2.4  GHz  specfrum.  Per  the  standard,  over- 
the-air  data  rates  faU  into  either  IMbs  or  2Mbs  categories.  Both  use  Gaussian  Erequency 
Shift  Keying  (GESK).  Two-level  GESK  yields  IMbs  rates,  while  four-level  GESK 
provides  the  2Mbs  rate  (Camthers  1995).  The  hopping  mles  defined  are  very  specific. 
79  channels  are  used  world  wide,  except  in  Japan  where  23  frequencies  are  the  standard 
(Canterbury,  1998).  Hops  must  achieve  at  least  six  channels  of  separation  from  the 
previous  channel,  and  an  EHSS  transmitter  must  tune  to  within  60Khz  of  /transmit  in  less 
than  224  microseconds.  EHSS  signals  appear  random,  but  are  predefined  and  monitored 
by  both  the  transmitter  and  receiver. 


Eigure  6.7.  EHSS  Waveform  on  Spectrum  Analyzer  (Erom  Eitzummons,  1997). 


As  stated  above,  dwell  time  for  a  single  transmitted  frequency  is  in  the  area  of  10 
milliseconds.  Typical  hop  rates  are  around  75  hops  every  half- minute,  or  approximately 
every  400  milliseconds.  EHSS  wireless  uses  Carrier  Sense  Multiple  Access/Colhsion 
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Avoidance  (CSMA/CA)  with  random  back  off,  a  variation  of  CSMA/Collision  Detection. 
The  three  authorized  bands  begin  at  902MHz,  2.4GHz,  and  5.7525Ghz  respectively 
(Proxim,  2001),  and  no  governed  site  license  is  required  for  operation.  The  technology 
calls  for  a  four- way  handshake  as  illustrated  (Rose-Hulman,  2001). 


Accott  Mabih» 

point  noOe 


Figure  6.8.  FHSS  Wireless  Handshake  (From  Rose-Hulman,  2001). 

2.  Direct-Sequencing  Spread  Spectrum  (DSSS) 

DSSS  expands  the  narrow  signal  across  the  broad  portion  of  the  transmission 
band.  DSSS  is  achieved  by  multiplying  a  data  signal  with  a  pseudo  noise  (PN- coded) 
signal.  The  PN-code  is  an  extremely  high  frequency  binary  signal  (large  bandwidth). 
Thus,  the  convolution  of  the  two  frequencies  spreads  the  signal  spectmm  of  the  data 
signal  to  the  wider  PN-coded  bandwidth,  i.e.,  the  data  is  “spread”  around  the  center 
frequency  (Fitzummons,  1997).  Since  the  noise-tike  signals  are  difficult  to  detect,  this 
technology  is  also  a  favorite  for  military  application  because  of  that  low  probability  of 
detection. 


Figure  6.9.  DSSS  Waveform  on  Spectmm  Analyzer  (From  Fitzummons,  1997). 
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As  with  FHSS  technology,  the  DSSS  receiving  device  is  famihar  with  the 
transmitting  device’s  encoding  pattern  and  decodes  accordingly.  Whereas  FHSS  uses  79 
channels,  DHSS  uses  eleven  channels,  each  22MHz  wide.  Of  the  eleven  prescribed 
channels,  however,  only  three  can  simultaneously  operate  in  the  2.4GHz  band  (at  the 
maximum  standard  11MB  data  transfer  rate)  without  overlapping.  The  TERR  802.11b 
standard  governs  DSSS  technology,  and  calls  for  fail-back  sequencing  of  data  rates  as 
follows:  11MB,  5.5MB,  2MB,  to  1MB. 

A  summary  of  spread  spectmm  technologies  shows  that  each  has  relative 
strengths  and  weaknesses.  Rrequency  Hopping  (802.11)  can  handle  more  users  per 
access  point,  has  very  strong  interference- immunity  characteristics,  and  is  a  more  mature 
(reliable)  technology.  Direct  Sequence  (802.11b)  is  faster--it  can  handle  up  to  11MB 
data  transfer  rates- -but  is  limited  in  scalabihty.  It  is  best  suited  for  low  device  density, 
high  data  rate  requirement  systems.  An  innovative  modulation  technique  called  Coded 
Orthogonal  Rrequency  Division  Multiplexing  (CORDM)  will  allow  bit- rate  technology  to 
exceed  54Mb/sec  (Anderson,  2001).  This  technique  transmits  data  in  an  immensely 
parallel  fashion.  It  also  compensates  for  problems  of  delay  spread  experienced  in  the 
2.4Ghz  band.  Delay  spread  is  the  unwanted  characteristic  of  a  signal  arriving  at  a  certain 
point  at  different  times  due  to  bouncing  off  obstacles  in  the  transmission  path. 


IEEE  Standard 

Modulation  type 

Data  Bandwidth 

Spectrum 

802.11 

RH,  DS,  Infrared 

2Mb,  1Mb 

2.4  GHz 

802.11b 

DS  only 

1 1Mb  (back  off  to 

2.4  GHz 

5.5,  2,  and  1  Mb) 

802.11a 

CORDM 

54Mb 

5.6  GHz 

Table  6.3.  Spread- Spectmm  Characteristics. 

F.  AN  EMPIRICAL  COMPARISON  OF  PRODUCTS 

The  two  wireless  solutions  used  to  help  provide  the  aathors  with  experiential  data 
were  the  integrated  Symbol  802.11  solution  and  the  Xircom  802.11b  solution.  The 
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Xircom  solution  was  used  to  connect  both  our  IBM  ThinkPad  laptop  and  the  Compaq 
iPaq  H3600  Pocket  PC  to  the  network.  Characteristics  such  as  battery  life  and  data 
throughput  of  the  devices  were  previously  discussed  in  Chapter  in. 

Both  solutions  were  fairly  easy  to  configure.  Physical  HotSync  of  the  Symbol 
devices  was  achieved  rather  quickly.  Wireless  configuration  of  the  HotSync  function  for 
the  devices  did,  however,  require  us  to  contact  the  Symbol  support  division.  After  a  short 
famiharization,  they  were  up  and  mnning.  Area  of  coverage  was  greatest  for  the  Symbol 
access  points  (see  Figures  6.10  through  6.12),  however  both  fell  short  of  advertised 
ranges.  This  was  due  in  part  to  stmctural  limitations  between  devices  and  access  points. 
The  radii  were  measured  to  the  point  where  connectivity  was  lost.  Because  of  the 
Symbol’s  greater  area  of  coverage,  those  access  points  were  able  to  be  physically  located 
in  existing  communications  closets  located  at  opposite  ends  of  the  treatment  facihty.  The 
hospital  first  floor  dimensions  are  353  feet  long  by  213  feet  wide.  The  Symbol  Sp)ectmm 
24  also  offered  40-bit  and  128-bit  encryption  packages. 

Due  to  the  smaller  area  of  coverage  of  the  Xircom  access  point,  that  device  was 
located  centrally  within  the  Family  Practice  clinic.  Configuration  of  the  Xircom  PC  Card 
for  the  iPaq  Pocket  PC  required  an  additional  driver  download,  which  was  accomphshed 
with  routine  ease.  The  Xircom  solution  provided  greater  administrative  fiinctionahty, 
including  a  comprehensive  set  of  diagnostic  tools.  This  solution  also  had  the  abihty 
select  40-bit  and  128-bit  encryption  packages.  The  lack  of  incorporated  encryption 
features  in  most  current  wireless  solutions  is  an  issue  that  needs  to  be  addressed  in 
industries  requiring  confidentiality  of  data  (Stammer,  2001).  Encryption  of  data  in  the 
healthcare  environment  will  be  discussed  in  greater  detail  in  Chapter  VII:  Security. 
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Figure  6.10.  Access  Point  Locations. 
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Figure  6.11.  Symbol  Access  Point  Area  of  Coverage. 
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Figure  6.12.  Xircom  Access  Point  Area  of  Coverage. 


65 


While  configuration  of  the  access  points  and  wireless  nodes  were  accomphshed 
with  relative  ease,  it  is  noted  that  management  of  network  configuration  and  connectivity 
for  these  assets  should  he  with  authorized  system  administrators.  Physical  and  network 
security  issues  surrounding  these  devices  and  their  apphcations  are  discussed  in  detail  in 
the  following  chapter. 

G.  FUTURE  APPLICATIONS 

TREE  finalized  the  802.11  standard  in  June  1997.  By  fall  of  1999,  they  had 
published  two  supplements  to  the  standard:  802.11a  and  802.11b  (Geier,  2000).  While 
the  private  sector  has  made  802.11b  products  readily  available,  development  of  solutions 
supporting  802.11a  have  been  longer  in  coming.  Some  benefits  of  802.11a,  which  uses 
Coded  Orthogonal  Erequency  Division  Multiplexing  (COEDM)  are  its  high  data  rates- -up 
to  54Mb/sec  in  20  MHz  channels--and  its  5.6  GHz  operating  fequency  range  (Anderson, 
2001).  Operating  in  this  range  will  allow  interference- free  coexistence  with  the 
Bluetooth  standard,  which  operates  in  the  2.4  MHz  range. 

As  healthcare  facihties  migrate  toward  a  more  integrated  wireless  environment, 
many  direct  and  indirect  benefits  can  be  expected.  Patient  administration  functions 
become  automated  as  changes  in  a  patient’s  status  automatically  trigger  a  physical 
transfer  (McCormick,  1999).  Voice  over  IP  phones,  based  on  H.323  standards,  will  allow 
providers  to  stay  in  constant  personal  communication  with  staff  members — a  capabihty 
currently  prohibited  by  bans  on  cellular  use  within  specifically  impacted  areas  of 
healthcare  facihties.  Caregivers  provide  triple  verification  when  scanning  medication 

barcodes,  patient  barcodes,  and  provider  barcodes,  ensuring  the  distributed 

pharmaceuticals  are  authorized  and  delivered  to  the  correct  patient  in  the  correct  dosage. 
The  system  has  already  automatically  checked  for  medical  contraindications  such  as 
adverse  dmg  interactions  and  proper  dosage  by  weight/age  allocation.  By  providing  real 
time  evaluations  and  documentation,  the  wireless  LAN  can  improve  a  facihties  audit 
results  on  Joint  Commission  on  Accreditation  of  Healthcare  Organizations  (JCAHO) 
studies,  and  its  legal  position  in  the  event  of  adverse  htigation. 

Healthcare  Informatics  magazine,  in  both  their  Eebruary  2000  and  2001  issues, 

hsted  wireless  capabihties  as  one  of  the  nine  hottest  technology  trends,  along  with  Supply 

Chain  Management  and  Interactive  and  E-business  technologies  (DeJesus,  2000  and 
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Stammer,  2001).  They  state  the  solution  is  in  response  to  the  demand  for  support 
applications  that  users  want.  Their  caveat  is  that  IT  managers  need  to  provide 
justification  for  the  cost  of  the  new  technology.  The  authors,  while  not  endorsing  the 
following  source,  provide  it  to  the  reader  as  a  justification  reference.  A  recent  study 
conducted  by  the  Wireless  Local  Area  Network  Alliance  (WLANA)  showed  the  average 
time  for  full  payback  of  initial  wireless  costs  was  less  than  nine  months,  and  that  97 
percent  of  customers  who  elected  to  install  wireless  LANs  had  met  or  exceeded 
expectations  of  competitive  advantage  (WLANA,  2001). 

H.  SUMMARY 

In  this  chapter  current  and  future  wireless  technologies  and  their  application  in  the 
medical  environment  were  explored  by  the  authors.  Among  current  technologies, 
Bluetooth,  Infrared,  802.11,  and  802.11b  all  have  contributing  value.  The  piconetworks 
enabled  by  Bluetooth  technology  will  play  an  expanding  role  as  multiple  personal 
wireless  devices  become  transparently  connected.  Infrared  offers  an  affordable  wireless 
solution  with  an  estabhshed  and  widely  supported  technology.  Frequency- Hopping  and 
Direct- Sequencing  Spread  Spectmm  solution  currently  provide  solution  offering  data 
transmission  rates  of  1  to  11  MB/sec.  However,  due  to  congested  bandwidth  and 
potential  growing  interference  with  biomedical  equipment,  advancements  in  802.11a 
operating  in  the  5.6GHz  spectmm  will  provide  the  greatest  increased  opportunities  for 
wireless  connectivity.  It  operates  in  a  frequency  band  separate  from  Bluetooth,  and  will 
allow  data  transfer  rates  of  54MB/sec,  supporting  emerging  medical  interactive  Voice 
Video  and  Data  (VVD)  technologies. 
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m  SECURITY 


A.  INTRODUCTION 

One  of  the  most  serious  concerns  of  Information  Technology  executives  is  the 
security  of  their  networks  and  the  data  that  lies  within.  In  this  chapter  the  authors  provide 
an  overview  of  the  federal  legislative  requirements  and  their  imphcation  for  healthcare 
facihties  as  it  apphes  to  Personal  Digital  Assistants  and  wireless  technologies.  Also 
addressed  in  detail  are  security  aspects  of  wireless  transmissions,  protection  of  patient 
data  while  in  electronic  format  (at  rest  on  the  PDA),  virus  concerns,  and  measures  of 
authentication  and  non-repudiation  of  transmitted  messages. 

B.  HEALTH  INSURANCE  PORTABILITY  AND  ACCOUNTABILITY 

(HIPAA)  ACT  OF  1996 

A  recent  survey,  conducted  at  the  annual  Healthcare  Information  Mana^ment 
Systems  Society  (HIMSS)  conference  and  exhibition  in  Febmary  2001,  hsted  upgrading 
security  to  meet  Health  Insurance  Portability  and  Accountabihty  Act  (HIPAA) 
requirements  as  the  top  priority  for  61  percent  of  the  nearly  500  healthcare  IT 
respondents.  This  concern  displaced  the  previous  year’s  lead  issue:  deployment  of 
Internet  technology  dropped  17  percent  to  a  2001  second-place  priority.  In  1996,  then- 
President  Clinton  signed  into  legislation  HIPAA,  estabhshing  the  patient’s  right  to 
privacy,  setting  minimum  security  standards,  and  defining  implementation  timelines  and 
enforcement  penalties.  The  HIPAA  Act  of  1996,  in  addition  to  ensuring  portabihty  of 
insurance  when  workers  transfer  to  a  new  place  of  employment,  also  defines  legislation 
which  protects  patient  health  information  by  setting  and  enforcing  security  standards. 

While  this  section  focuses  on  the  accountability  aspects  of  HIPAA,  we  do  not  discount 

the  importance  of  insurance  portabihty  issues.  For  a  good  overview  of  portabihty  issues, 
the  reader  is  directed  to  the  fohowing  sources. 

•  Health  Care  Financing  Administration  (HCFA)  HIPAA  Welcome  Page 
http://www.hcfa.gov/medicaid/hipaa/ 

•  US  Department  of  Health  and  Human  Services  (DHHS)  Administrative 
Simplification  http://aspe.hhs.gov.admnsimp/ 

The  U.S.  Department  of  Health  and  Human  Services  has  cognizance  over  the 
security  requirements  defined  by  HIPAA. 
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1.  Rules  Processing 

The  U.  S.  Department  of  Health  and  Human  Services  follows  a  formal  process  for 
developing  those  standards  (Branco,  2000).  DHSS  first  develops  recommendations  and 
pubhshes  those  proposed  rules  in  the  Federal  Register.  The  Notice  of  Proposed  Rule 
Making  remains  on  the  register  for  a  60- day  Comment  Period,  at  which  time  comments 
are  analyzed  for  incorporation  into  the  mles.  The  Final  Rule  is  then  developed  and 
published  on  the  register,  at  which  time  healthcare  entities  are  required  to  begin 
comphance.  In  most  cases,  comphance  for  each  individual  mle  must  be  achieved  within 
two  years.  Smaller  health  plans  may  have  up  to  36  months  to  comply.  Comphance 
timehnes  are  presented  later  in  this  section. 

2.  Applicability  and  Penalties 

The  Act  directly  applies  to  healthcare  providers  who  transmit  any  health 
information  in  electronic  format,  pubhc  and  private  health  plans  (e.g.  Blue  Cross,  Kaiser, 
Medicare,  Medicaid),  and  clearinghouses  (those  services  which  provide  storage  and 
transmittal  of  patient  data.  The  definition  of  health  information  is  laid  out  in  section  1171 
of  the  Act.  Roughly  presented  here,  it  is  any  information,  in  any  form  or  medium, 
created  or  received  by  the  healthcare  entity  (provider,  hospital,  plan,  university,  insurer, 
etc.),  that  relates  to  the  past,  present,  or  future  physical  health,  mental  health,  condition, 
provision  of  health,  or  payment  for  the  provision  of  health.  The  civil  penalties  for 
violating  this  Act  include  $100  per  episode,  and  up  to  $25,000  per  calendar  year  for 
multiple  violations  of  a  single  provision.  The  criminal  penalties  place  a  greater  onus  on 
the  provider  to  protect  patient  information:  up  to  $50,000  and/or  imprisonment  for  one 
year.  If  conducted  under  false  pretenses,  the  penalty  escalates  up  to  $100,000  and/or  a 
live- year  imprisonment.  Finally,  if  the  unauthorized  disclosure  of  patient  information  is 
used  for  personal  gain,  commercial  advantage,  or  mahcious  harm,  the  penalty  is  up  to 
$250,000  and/or  10  years  in  prison.  It  is  evident  that  in  addition  to  improving  business 
efficiencies  with  respect  to  electronic  data  and  conducting  healthcare  dehvery  in  a 
manner  that  agrees  with  our  beneficiaries,  providers  now  have  other  incentives  to  ensure 
mPAA  compliance. 


70 


3.  fflPAA  in  Detail 

The  Act  repeatedly  states  that  the  patient’s  right  to  privacy  should  be  reasonable. 
While  this  is  not  a  definitive  explanation,  and  the  use  of  specific  technology  is  not 
mandated  within  the  security  mles,  a  reasonable  level  of  effort  must  be  made  to  ensure 
privacy.  Also  be  aware  that  state  privacy  laws,  when  more  restrictive  than  the  federal 
HIPAA  legislation,  have  priority.  Disclosure  of  patient  information  must  be  kept  to  a 

minimum,  and  can  only  occur  with  consent,  authorization,  or  when  compelled  by  legal 

requirement.  Patients  can  request  disclosure  restrictions,  information  amendments, 
access  to  their  information,  and  provider  information  practices.  Keeping  all  of  this  in 
mind,  providers  cannot  lock  down  information  so  tightly  that  it  impedes  the  dehvery  of 
healthcare.  Some  level  of  risk  must  be  assumed  in  order  to  ensure  continued 

provisioning.  That  said,  providers  also  have  the  responsibihty  of  due  dihgence  when  it 

comes  to  protecting  patient  information.  They  must  effect  reasonable  measures  of 
control  to  ensure  confidentiahty.  Risk  analysis,  needs  assessment,  and  pohcy 
development  need  to  be  addressed  individually  by  entities  to  determine  local  business 
requirements  for  HIPAA  comphance.  It  is  critical  that  documentation  be  maintained  to 
indicate  why  decisions  where  made  in  the  areas  indicated.  Ideally,  this  will  help  to 
ensure  proper  level  of  effort.  The  measures  fisted  in  the  following  table  apply  not  just  to 
PDAs,  but  also  to  information/information  systems  in  general. 


Information  System  Security  Measures 

Administrative 

Roles  and  Responsibilities 

Policies  and  Procedures 

Training  and  Awareness 

Security  Planning 

Physical 

Access  Control  (locked  doors,  escorts) 

Computer  Workstations 

Media  Controls 

Technical  Services 
and  Mechanisms 
(Data  in  transit  or 
at  rest) 

Integrity  Controls 

Message  authentication 

Access  controls/encryption 

Alarms 

Audit  trails 

Entity  authentication/non-repudiation 

Event  reporting  1 

Table  7.1.  Summary  of  Measures  for  Information  System  Security  Plans.  (From 

Walsh  2001). 
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HIPAA  regulations  wiU  force  healthcare  entities  to  implement  heightened  security 
measures.  Until  the  first  several  iterations  of  comphance  are  achieved,  the  Act  will 
reduce  the  rate  at  which  healthcare  IT  innovation  has  pervaded  in  recent  years.  Most 
organizations  have  two  years  to  comply  from  the  date  the  signing  of  specific  Act  areas. 


HIPAA  Timeline 

Transactions  and  Code  Set: 

October  16,  2002 

Privacy: 

April  14,  2003 

Security  Requirements: 

To  be  determined 

Unique  Identifiers: 

To  be  determined 

Enforcement  Procedures: 

To  be  determined 

Table  7.2.  U.  S.  Department  of  Health  and  Human  Services  HIPAA  Compliance 

Timeline  (From  DHHS,  2001). 

Transactions  mandate  entities  to  streamhne  the  processing  of  health  care  claims, 
reduce  the  volume  of  paperwork  and  provide  better  service  for  providers,  insurers  and 
patients.  The  new  standards  estabhsh  standard  data  content  and  format  for  submitting 
electronic  claims  and  other  administrative  health  care  transactions  (HHS,  2001).  The 
Privacy  Rule  is  that  portion  of  the  act  that  gives  patients  more  control,  estabhshes 
boundaries  for  use  and  release  of  health  data,  and  mandates  healthcare  providers  establish 
appropriate  safeguards  to  protect  patient  privacy.  Security  will  address  improper  access 
or  alteration  of  data,  while  Identifiers  will  direct  standardized  unique  identifiers  be 
assigned  to  employers,  providers  and  health  plans.  These  three  identifiers  are  being 
addressed  separately. 

4.  Compliance 

Preliminary  results  of  the  HIMSS  Leadership  Survey  conducted  in  Febmary 
shows  the  following  industry  comphance  rates. 
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HIPAA  Compliance  Rates 

54% 

Installed  security  technologies 

53% 

Assesses  organizational  comphance 

47% 

Documented  security  pohcies 

34% 

Hired  Security/Privacy  Officers 

32% 

Implemented  security  procedures 

16% 

Hired  consultant  to  assess  readiness 

14% 

Have  not  begun 

Table  7.3.  Industry  Wide  Compliance  Rates  as  of  February  2001  (From  Dash,  2001). 

These  figures  indicate  that  in  an  industry  responsible  for  protecting  patient 
privacy,  and  as  network  speciahst  responsible  for  affecting  that  level  of  protection  with 
respect  to  electronic  data,  we  have  fallen  well  short  of  the  ideal.  Last  year  a  25- year- old 
Dutch  hacker  identified  as  Kane  infiltrated  the  University  of  Washington  Medical 
Center’s  computer  system  (Chin,  2001).  The  hacker  gained  access  to  an  administrative 
database  that  contained  the  records  of  over  5,000  cardiology  and  rehabihtation  patients. 
The  information  obtained  included  patient  names,  addresses,  social  security  numbers,  and 
the  medical  procedures  that  they  had  undergone.  Admittedly,  security  of  the  system  was 
weak.  The  following  sections  address  security  focus  areas. 

C.  INFORMATION  ASSURANCE 

The  desired  outcome  of  HIPAA  is  to  ensure  availabihty,  confidentiahty,  and 
integrity  of  patient  data  at  all  times.  Additionally,  it  is  necessary  to  ensure  pohcies  and 
methods  authentication,  certification,  and  reconstitution  of  all  electronic  data  are  in  place 
and  being  utilized. 

•  Confidentiahty  refers  to  protecting  patient  data  from  unauthorized  access. 

•  Integrity  of  patient  data  refers  to  the  assurance  that  data  has  not  been 
altered. 

•  Authentication  vahdates  the  source  location  of  data. 

•  Availability  refers  to  the  capacity  of  a  system  to  provide  the  required  data 
at  the  required  time. 

•  Certification,  sometimes  referred  to  as  non-repudiation,  confirms  the  data 
sender. 

•  Reconstitution  provides  for  the  swift  recover  of  data 
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The  following  tables  will  assist  the  reader  in  defining  their  own  position  with 
respect  to  HIPAA  and  administrative  procedures  and  physical  safeguards  to  guard  data 
confidentiahty,  integrity,  and  availabihty.  Using  technology  to  help  comply  with  these 
desired  outcomes  is  the  focus  of  the  remaining  sections  of  this  chapter. 


Administrative  Procedures  to  Guard  Data  Integrity,  Confidentiality  and 

Availability 

HIPAA  Requirement 

Certification 

Chain  of  trust  partner 
agreement 

Implementation 

Contingency  plan  ( all  listed 

• 

Applications  and  data  criticality  analysis. 

implementation  features  must 

• 

Data  backup  plan. 

be  implemented). 

• 

Disaster  recovery  plan. 

• 

Emergency  mode  operation  plan. 

Formal  mechanism  for 
processing  records. 

• 

Testing  and  revision. 

Information  Access  Control 

• 

Access  authorization 

(all  listed  implementation 

• 

Access  establishment. 

features  must  be 
implemented). 

• 

Access  modification. 

Internal  audit 

Personnel  security  ( all  listed 

• 

Assure  supervision  of  maintenance. 

implementation  features  must 

• 

Maintenance  of  record  of  access 

be  implemented). 

authorizations. 

• 

Operating,  and  in  some  cases,  maintenance 
personnel  have  proper  access  authorization. 

• 

Personnel  clearance  procedure. 

• 

Personnel  security  policy /procedure. 

• 

System  users,  including  maintenance 
personnel,  trained  in  security. 

Security  configuration  mgmt. 

• 

Documentation. 

(all  listed  implementation 

• 

Hardware/software  installation  &  maintenance 

features  must  be 

review  and  testing  for  security  features. 

implemented). 

• 

Inventory. 

• 

Security  Testing. 

• 

Vims  checkins. 

Table  7.4a.  HIPAA  Security  Matrix- Administrative  Safeguards  from  Proposed  Rule 
Published  August  1998  (From  Bogen,  2001). 
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Table  7.5.  HIPAA  Security  Matrix- Physical  Safeguards  from  Proposed  Rule 
Published  August  1998  (From  Bogen,  2001). 
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Table  7.7.  HIPAA  Security  Matrix- Technical  Security  Mechanisms  from  Proposed 
Rule  Published  August  1998  (From  Bogen,  2001). 
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D.  ENCRYPTION 


The  security  risks  experienced  by  both  wired  and  wireless  networks  are  similar 
(Weatherspoon,  2001).  Both  need  to  protect  against  threats  to  physical  security  (external 
sabotage  or  distributed  denial  of  service  (DDOS)  attacks;  unauthorized  access  from 
eavesdropping;  and  internal  attacks  from  authorized  users.  This  section  will  discuss  the 
need  for  encryption  of  patient  data  under  two  conditions:  during  transmission  and  while 
at  rest.  As  discussed  in  Chapter  IV,  wireless  LAN  transmissions  conform  to  specific 
standards:  IEEE  802.11  for  EHSS  and  DSSS,  IrDA  for  infrared,  and  IEEE  802.15 
(Wireless  Personal  Area  Network)  for  Bluetooth.  Very  few  wireless  EANs  installed  as  of 
2000  featured  encrypted  transmissions  (Mitchell,  2000).  Signals  near  wireless  access 
points  can  be  captured  and  observed,  as  indicated  by  the  photo  below.  In  an  unencrypted 
environment,  that  means  the  signal  is  indicative  of  live  network  traffic.  The  display 
indicates  two  11MB  Direct  Sequence  transmissions.  The  one  on  the  left  is  from  an 
access  point  that  is  experiencing  heavy,  continuous  network  traffic,  and  thus  has  a  more 
defined  signal. 


Eigure  7.1.  Spectmm  Analyzer  Display  of  Captured  2.4  GHz  Wireless  Transmission 

(From  Mitchell,  2000). 


Spread- Spectmm  (SS)  modulation  characteristics  alone  provide  only  a  modicum 
of  security  with  respect  to  transmission.  In  order  to  intercept  actual  data  during 
transmissions,  one  of  two  compromising  situations  must  have  occurred.  Some  piece  of 
hardware,  e.g.  a  network  interface  card,  must  have  been  stolen,  or  the  software  defined 
network  identifier  must  have  been  disclosed.  That  Extended  Service  Set  ID  (ESSID) 

definition  is  part  of  an  administrator’s  initial  wireless  network  configuration  that 

77 


identifies  a  workgroup  subnet.  The  ESSID  is  very  susceptible  to  unofficial  disclosure. 
An  unauthorized  connection  only  requires  an  intruder  to  have  brief  access  to  a  wireless 
node  (laptop,  PDA)  in  order  to  determine  the  ESSID  and  encode  his  or  her  own 
compatible  wireless  device. 

E.  WIRED  EQUIVALENCY  PRIVACY  (WEP) 

The  most  readily  available  method  to  further  protect  data  during  transmission  is 
the  Wired  Equivalency  Privacy  (WEP)  protocol,  which  provides  hnk- level  protection. 
The  WEP  protocol  address  the  confidentiahty  issues  prescribed  by  HIPAA,  that  is  it 
protects  patient  data  from  eavesdropping  during  wireless  transmissions.  The  WEP 
algorithm  was  selected  as  an  encryption  solution  for  the  802.11b  protocol  because  it  met 
the  following  criteria  (Weatherspoon,  2001): 

•  Reasonably  strong 

•  Self-  synchronizing 

•  Computationally  efficient 

•  Exportable  to  other  countries 

•  Optional 

I.  WEP  Encryption  Process 

With  WEP  encryption,  the  40- bit  key  is  concatenated  with  a  24- bit  initializing 
vector  (IV),  resulting  in  an  overall  key  size  of  64  bits.  This  concatenated  key  is  then  fed 
into  a  pseudorandom  number  generator  (PRNG),  which  yields  an  RC4  pseudorandom 
sequence  based  on  the  input  key.  A  CRC-32  integrity  algorithm  is  used  to  compute  an 
integrity  check  value  (ICV)  of  the  plaintext  message,  thus  providing  protection  from 
unauthorized  modification  of  the  message.  The  pseudorandom  key  sequence  is  then  used 
to  encrypt  the  message  (plaintext  -i-  ICV).  The  same- shared  key  is  used  to  encrypt, 
decrypt,  and  authenticate  the  sender.  The  40- bit  encryption  standard  was  developed  to 
comply  with  limiting  export  requirements  then  in  place.  Most  vendors  also  now  offer 
128-bit  solutions.  128-bit  encryption  for  802.11  systems  is  reahzed  in  the  same  manner. 
A  104- bit  key  is  concatenated  with  a  24- bit  IV  to  produce  an  overall  key  size  of  128  bits. 
Where  40- bit  encryption  is  somewhat  susceptible  to  a  determined  hacker  using  bmte 
force  attacks,  the  larger  key  size  effectively  eliminates  this  sort  of  unwanted  intmsion. 
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As  detailed  in  the  next  section,  however,  it  wiU  become  clear  that  even  128-bit  WEP  is 
not  secure  against  a  determined  attacker. 

2.  WEP  VulnerabUities 

The  goals  of  encryption  are  to  provide  message  data  with  confidentiahty,  integrity 
and  authenticity.  In  the  past  nine  months,  several  independent  sources  have  proven  that 
WEP  encryption  is  not  secure,  and  that  none  of  the  goals  are  actually  met  with  WEP. 
The  weakness  has  been  identified  not  in  the  RC4  encrypted  component  of  the  algorithm 
(either  40  bit  or  104  bit),  but  in  the  24-bit  IV  component  (Walker,  2000).  Since  the  size 
of  the  rv  is  so  small,  and  the  protocol  calls  for  the  possibihties  to  be  exhausted  before 
reuse  happens,  reuse  of  an  IV  can  occur  in  less  than  five  hours — much  less  if  a  station  or 
group  of  stations  is  extremely  active  (Boiizov,  2001).  By  using  only  passive  attacks  an 
eavesdropper  can  monitor  wireless  transmissions  until  an  IV  coUision  occurs.  The 
Berkley  group  comprised  of  Boiizov,  Goldberg,  and  Wagner  discusses  in  their  paper  how 
an  attacker  can  construct  correctly  encrypted  messages  and  insert  them  into  a  network, 
modify  packet  headers  to  redirect  messages  to  an  unauthorized  IP,  and  forward 
unencrypted  messages  through  open  ports  in  a  firewall  (e.g.  port  80).  They  also  surmise 
that  the  small  space  of  possible  IVs  can  allow  a  hacker  to  build  a  table  over  comprised  of 
all  possible  IVs  and  corresponding  RC4  encrypted  key  streams.  That  table  would  require 
less  than  15  GB  of  space,  and  would  allow  a  hacker  to  decrypt  every  message  broadcast 
wirelessly  over  your  network.  This  sort  of  parking  lot  attack  can  occur  without  an 
intmder  ever  entering  a  facihty’s  physical  premises.  Given  a  wireless  component  in  one’s 
network,  the  presence  of  a  firewall  in  a  mihtary  treatment  facihty  may  increase  the 
vulnerabUity  to  this  type  of  attack  because  of  the  false  sense  of  security  derived  by 
network  administrators  (Arbaugh,  2001). 
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Figure  7.2.  Illustration  of  Parking  Lot  Attack  (From  Arbaugh,  2001). 

F.  PRETTY  GOOD  PRIVACY  (PGP) 

PGP  is  a  public -key  cryptography  program.  Its  uses  include  personal  file 
encryption  to  message  encryption.  Before  defining  public  key  cryptography,  it  will  help 
to  explain  the  disadvantages  of  systems  tike  the  Data  Encryption  Standard  (DES),  which 
uses  symmetric  cryptography. 

1.  Symmetric  Cryptography 

DES  utilizes  a  very  robust  encryption  algorithm,  providing  great  security  for 
electronic  data.  Its  weakness  lies  in  key  management.  Symmetric  cryptography  uses  a 
single  key  to  both  encrypt  and  decrypt  a  file  or  message.  As  long  as  there  a  relatively 
few  number  of  users  involved  this  solution  works  quite  well.  As  you  will  see,  once  the 
number  of  users  grows  even  a  tittle,  the  system  becomes  very  difficult  to  manage. 

The  formula  for  determining  the  number  of  keys  per  node  is  given  as 

n{n  -1) 

2 

Thus,  if  the  number  of  nodes  in  the  system  is  three,  the  number  of  necessary  keys 


If  the  number  of  user  nodes  grows  to  20,  we  find  that  required  keys  to  manage  are 

=190 

2 

The  safeguards  necessary  to  transport  and  securely  manage  that  large  number  of 
keys  would  soon  be  overwhelming  to  any  of  our  treatment  facihties,  let  alone  looking  at 
it  from  an  enterprise  perspective. 

2.  Public  Key  Cryptography 

Pubhc  key  technology  uses  only  two  complementary  keys:  a  pubhc  key  and  a 
private  key  for  each  user.  Pubhc  keys  are  made  available  to  those  wishing  to  encrypt  a 
message  to  the  pubhc  key  owner.  For  example,  if  Mike  wanted  to  send  Beth  an 
encrypted  message,  he  would  request  from  Beth  her  pubhc  key  and  use  that  to  encrypt  the 
data.  Beth  is  the  only  person  who  can  decrypt  the  message  using  her  private  (secret)  key. 
The  number  of  keys  required  for  this  system  is  given  as 

2n 

For  three  users,  the  number  of  keys  required  totals  six.  For  the  20  users  given  in 
the  example  above,  the  number  of  keys  required  is  only  40  (vice  the  190  shown). 
Understand  that  key  management  is  shll  required.  If  Bob  was  able  to  replace  Beth’s 
pubhc  key  with  his  own,  he  would  then  be  able  to  intercept  and  decrypt  and  messages 
intended  for  her. 

G.  COMMERCIAL  ENCRYPTION  SOLUTIONS 

While  currently  no  transmission  encryption  protocols  are  commerciahy  available 
for  the  802.11  solutions,  efforts  are  underway  to  correct  the  deficiencies  exhibited  in  the 
previous  section.  This  may  manifest  itself  either  as  a  modification  to  or  replacement  of 
the  WEP  encryption  method.  While  waiting  for  that  solution  protecting  patient  data 
while  at  rest  still  needs  to  be  addressed.  Providers  are  still  capable  storing  patient  data  on 
their  PDAs  either  via  manuahy  entry  or  physicahy  syncing  their  device  to  their  host 
computer/network.  Palm  OS  and  Pocket  PC  devices  both  come  with  password  protection 
as  part  of  their  standard  application  suite.  These  password  programs  provide  only  a 
cursory  level  of  protection  for  the  data  contained  on  your  PDA.  In  fact,  the  biggest 
security  threat  to  the  personal  digital  assistant  is  loss  (Crouch,  2001).  Until  hardware 
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vendors  begin  packaging  stronger  security  software,  it  is  essential  that  some  third-party 
password  and  encryption  apphcations  be  included  as  part  of  a  standard  software  suite. 
Discussion  of  the  following  products/product  types  is  used  for  illustrative  purposes  only, 
and  does  not  necessarily  indicate  endorsement  of  the  writers. 

Some  downloadable  apphcations  may  serve  to  provide  ah  the  protection  a 
network  administrator  needs  to  ensure  that  PDAs  are  given  the  level  of  effort  indicated  by 
their  fachity’s  pohcy  in  order  to  comply  with  the  previously  mentioned  fHPAA 
requirements.  Due  to  the  larger  memory  and  processing  capabilities  of  Pocket  PC 
devices  over  Palm  OS  devices,  security  software  for  the  former  tends  to  be  more  robust. 

1.  PDABomb 

A  Pahn-based  apphcation  that  provides  both  enhanced  password  functionality  and 
encryption.  It  has  a  selectable  “bomb”  which  activates  after  a  pre- assigned  number  of 
unsuccessful  login  attempts  are  recorded.  The  bomb,  when  activated,  erases  ah  data  on 
the  PDA.  This  apphcation  also  disables  data  transfer  mechanisms  such  as  HotSync  and 
IrDA  ports  unless  the  proper  password  is  entered.  The  apphcation  does  not  store  the 
actual  password  on  the  device,  only  an  encrypted  form.  PDABomb  also  initializes  first 
after  a  device  reset,  ensuring  its  functionahty.  Additionahy,  it  functions  to  keep  data 
encrypted  when  Handspring  Springboard  memory  modules  are  removed. 


Password:  Unassigned - 

Encryption: 'V  No 

□  Lock  device  on  poiwer-off 

□  Rttempts  limit 

Read  the  documentation  carefully 
before  enabling  this  feature! 

[  Setup  encryption...  ) 

[Turn  Off  &  Lock  device!!^ 


Figure  7.3.  PDABomb  Configuration  Screen  Capture  (From  PDABomb,  2001). 
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2.  OnlyMe 

From  Tranzoa,  is  a  Palm-based  application  that  provides  additional  password 
protection  functionality.  With  up  to  seven  button  or  stroke  combinations,  it  avails  the 
user  to  nearly  350,000  password  possibilities.  After  five  incorrect  password  attempts,  the 
device  locks  for  7  minutes.  Five  more  incorrect  attempts  yield  a  14-minute  lockout. 
Further  sets  of  five  incorrect  entries  wiU  lock  the  device  out  for  28-minute  increments.  If 
a  user  forgets  their  password,  they  will  need  to  perform  a  cold  reset,  and  restore  any  data 
from  backup.  An  initial  power  up  screen  can  be  customized  to  provide  displayed  contact 
information. 


OnlylMe 


^  Enable  OnlyMe 
[Sf  Fast  Start 

Set  password 


Private  Records 

•w'  Mask  private  records 


B!  RIIoou  RIarm  Display 


Ef  Lock  Delay;  ISlSecondHts 
Ef  Instant  PouieilMu^S 
Picture;  I  CapuE£2L^_l 

Trial  Version  2.23 


Figure  7.4.  Initial  Configuration  Screen  Capture  (From  OnlyMe,  2001). 

3.  Sentry  20/20 

This  is  a  Pocket  PC  solution  offering  encryption  that  has  a  minimum  128- bit  key. 
The  application  creates  an  encrypted  virtual  volume,  and  all  folders,  files,  and 
applications  placed  on  that  volume  are  transparently  encrypted/decrypted  every  time  a 
read  or  write  operation  is  performed.  The  solution  utilizes  the  CAST- 128  encryption 
algorithm,  and  can  maintain  the  key  in  one  of  two  ways.  If  strong  password  pohcy  is 
enforced,  the  key  can  be  maintained  on  the  Pocket  PC  device  itself.  If  weak  (or  no) 
passwords  are  used,  it  is  recommended  that  the  key  be  stored  on  removable  media,  e.g., 
compact  flash  cards.  As  with  other  third-party  apphcations,  if  the  password  is  forgotten 
or  the  key  is  lost,  a  hard  reset  must  be  performed  and  data  must  restored  from  backup. 
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t  4:05  AM  ■Jj 


Figure  7.5.  Sentry  20/20  CE  1.8  Screen  Capture  (From  Sentry  20/20,  2001). 


4.  PocketLock 

This  is  another  Pocket  PC  based  encryption  program  that  ofiers  flexibility  in 
choosing  both  the  data  to  be  encrypted  and  the  level  of  encryption  served.  Encryption 
options  range  from  40-bit  RC2  to  168-bit  triple  DBS.  ARC4  (128-bit  RC4  compatible)  is 
the  default  selection.  The  following  hst  provides  all  encryption  options  available.  Note 
that  those  listed  with  an  asterisk  (*)  require  the  user  to  download  and  install  the  Microsoft 
High  Encryption  Pak  from  the  PocketPC.com  website. 

•  ARC4  (128-bit  RC4  compatible) 

•  RC2  (40  bit) 

•  RC4  (40  bit) 

•  DBS  (56  Bit) 

•  RC2  (128  bit)* 

•  RC4  (128  bit)* 

•  3DES  TWO  KEY  (1 12  bit)* 

•  3DES  (168  bit)* 

PocketEock  also  offers  an  encryption  solution  for  desktop  devices.  It  should  be 
noted  that  some  files,  once  encrypted  on  either  the  PDA  or  desktop,  will  not  be  able  to  be 
read  on  a  device  other  than  the  one  which  handles  original  encryption. 
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12]  PocketLock  6:46p  @ 


Pick  an  Encryption  Library; 


Microsoft  Base  Cryptographic  Provider  vl  .0 


Pick  an  Encryption  Method: 

RC2  (40  bit) 

RC4  (40  bit) 

DES  (56  bit) 


IMPORTANT:  If  you  are  also  using 
PocketLock  on  a  PC,  make  sure  the  method 
and  provider  you  select  are  also  available 
on  the  PC. 


Cancel 


Figure  7.6.  PocketLock's  Software  Encryption  Solution  Screen  Captures  (From 

PocketLock,  2001). 


5.  MovianCrypt 

Movian  is  the  Pakn-based  encryption  solution  ofTered  by  Ceiticom.  The 
application  addresses  the  issues  of  password  vulnerabilities  and  unsecured  data  at  rest  by 
extending  the  basic  functionahty  of  the  Palm  OS  device.  The  cipher  used  is  the  128-bit 
Advanced  Encryption  Standard  (AES).  Encryption/decryption  occurs  below  the  Palm 
apphcation  layer,  so  that  its  operation  is  transparent  to  the  user.  The  product  also  touts  a 
simple  graphical  user  interface  (GUI)  and  installation  process.  It  also  prevents  against 
unauthorized  access  to  the  device  and  data  via  known  Palm  security  holes  such  as  the 
HotSync  function  and  EDA  beaming  by  requiring  password  authentication  prior  to 
operation.  MovianCrypt  provides  an  option  for  predetermining  the  time  before  automatic 
lockout  occurs  at  power  down.  Finally,  it  safeguards  the  password  against  unwanted 
access  on  the  device  or  HotSync  partner  by  only  maintaining  a  hash  of  the  password  and 
encryption  key  on  the  PDA. 
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Figure  7.7.  MovianCrypt  Data  Encryption  Process  (From  MovianCrypt,  2001). 

Other  security  measures  will  play  a  more  integral  role  as  they  develop  into 
economically  feasible  solutions.  Bluetooth  technology  will  soon  provide  a  reasonable 
access  solution  for  those  who  wish  to  use  Bluetooth- enabled  physical  “keys”  in 
conjunction  with  manual  passwords.  Advancements  are  being  made  in  the  area  of  pubhc 
key  infrastmcture  (PKI)  development  with  respect  to  mobile  technologies.  Biometrics 
win  soon  be  affordable  options  for  network  administrators.  While  retinal- scanning 
technology  is  a  viable,  albeit  expensive,  option  for  desktop  or  network  access,  solutions 
are  currently  being  offered  for  fingerprint  recognition  access  to  mobile  devices.  Expect 
costs  of  these  technologies  to  continue  to  drop,  and  consider  the  facility’s  needs  vice 
wants  when  determining  appropriate  security  solutions. 

H.  VIRUS  CONCERNS 

While  the  number  of  vims  attacks  directed  at  mobile  devices  has  remained  fairly 
small,  both  Symantec  and  McAfee,  leaders  in  the  development  and  maintenance  of 
antivims  software,  expect  sharp  increases  as  the  PDA  industry  growth  makes  them  an 
attractive  target  for  hackers  (Crouch,  2001).  While  in  excess  of  one  million  PDA  devices 

86 


were  sold  last  year,  estimates  place  the  number  of  handhelds  in  the  market  place  by  2003 
at  nearly  20  million.  As  with  the  advent  of  any  new  communications  technology,  the 
chance  for  hackers  to  develop  mahcious  code  for  portable  devices  is  not  just  an 
opportunity,  it  is  a  challenge.  Concomitandy,  the  challenge  as  technology  advisors 
within  organizations  is  to  ensure  the  continuous  education  of  staff  on  proper  security 
measures  with  which  to  combat  those  undesirable  elements.  With  respect  to  malevolent 
code  in  the  wireless  environment,  the  threat  to  PDAs  comes  in  two  forms  (Trend  Micro, 
2001). 

Application-based  threats  occur  when  malicious  code  attaches  itself  to  new  or 
existing  wireless  software.  The  threat  comes  when  an  application  is  either  downloaded 
onto  your  device,  or  executed  once  it  is  already  installed.  Receiving  apphcations  from 
unknown  sources,  i.e.  “shareware”,  increase  this  potential.  In  August  2000  the  Trojan 
horse  ‘Liberty  Crack”  made  it’s  streaking  presence  known.  The  free  download  purported 
to  convert  a  shareware- based  game  into  a  registered  version.  Unbeknownst  to  the  PDA 
user,  once  the  apphcation  was  executed  it  proceeded  to  delete  all  other  executable 
programs  on  their  device.  While  the  example  used  here  shows  transference  to  devices  via 
shareware  games,  it  illustrates  two  key  points.  First,  mahcious  code  can  be  developed 
and  transmitted  through  similar  legitimate  means — the  technology  is  the  same.  Second, 
to  ascertain  if  the  devices  that  customers  are  using  do  not  contain  these  shareware 
programs,  try  performing  a  random  inspection.  The  development  of  a  sound  pohcy  and 
the  staff  education  wiU  be  key  in  protecting  your  network.  Guidance  on  that  policy 
development  can  be  found  in  references  hsted  in  the  foUowing  section  and  in  Chapter 

vn. 

Content-based  threats  make  mahcious  use  of  the  content  or  message  itself. 

Presently,  the  most  susceptible  apphcation  on  your  PDA  (as  weh  as  your  PC)  is  e-mail. 

The  first  content-based  threat  to  wireless  devices  appeared  just  one  year  ago.  The 

mahcious  Visual  Basic  Script  ‘Timofonica”  rephcated  by  sending  e-mail  messages  over 

wireless  networks  to  ah  addressees  of  their  Microsoft  Outlook  Address  Book.  Another 

attack  occurred  around  the  same  time  in  Japan.  In  that  case,  their  emergency  110  system 

(similar  to  our  911  system)  was  accessed  without  the  reader’s  knowledge  when  the  user 

choked  on  a  hyperhnk  in  their  e-mail  message.  This  demonstrates  the  abihty  of  wireless 
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devices  to  have  a  serious  detrimental  impact  on  key  services  or  networks.  The  fear  of 
many  is  that  the  development  of  hybrid  vimses,  those  which  combine  the  characteristics 
of  both  content-based  and  application-based  threats,  would  enable  spreading  of  malicious 
code  at  such  a  prolific  rate  as  to  devastate  those  key  infrastructures. 

Several  vendors  have  begun  to  offer  antivims  protection  for  Personal  Digital 
Assistants. 


PDA  Antivirus  Solutions 

Symantec 

Current  solution  is  Antivirus  2001  for  Palm  OS.  Every  time  your  PC 
connects  to  the  internet,  Symantec  LiveUpdate  will  update  the  program 
definition  files.  These  will  be  updated  on  your  Palm  device  during  the 
subsequent  HotSync. 

McAfee 

Supports  Pocket  PC,  Windows  CE  and  Symbian’s  EPOC,  as  well  as  the 
Palm  Operation  Systems  with  their  VimsScan  wireless  solution.  The 
application  protects  against  virus  receive  during  physical,  wireless,  or 
infrared  synchronization/transmission,  and  also  addresses  dormant  viruses 
that  attack  the  OS  directly. 

Trend  Micro 

PC-Cillin  for  Wireless  proyides  two  means  of  detection.  Real-time  scanning 
will  intercept  a  yirus  as  its  carrier  attempts  transmission  into  your  deyice  yia 
physical,  wireless,  or  infrared  connection.  Altematiyely,  the  user  can  initiate 
a  manual  scan  of  the  entire  PDA  enyironment  at  any  time.  This  product  has 
solutions  for  the  Palm,  Pocket  PC  and  EPOC  systems. 

Table  7.8.  Examples  of  Commercial  PDA  Antivims  Apphcations. 

I.  DEPARTMENT  OF  THE  NAVY  (DON)  POLICffiS 

Use  of  Personal  Electronic  Devices  (PED),  especially  in  a  wireless  environment, 
is  becoming  very  widespread.  Under  the  Job  Performance  Aids  (JPAs)  for  Newly 
Commission  Officers  Program,  the  CNO  has  authorized  the  purchase  and  distribution  of 
PDAs  for  all  new  officer  accessions.  Guidance  on  the  use  of  PDAs  can  be  found 

throughout  the  Department  of  the  Navy.  While  some  sources  are  more  restrictive  than 

others,  aU  seem  to  have  some  basic  underlying  themes.  They  are  presented  here  in  no 

specific  order  of  priority.  Comments  in  this  section  refer  to  the  use  of  PDAs  in  an 

unclassified  data  environment.  Eor  suggestions  on  policy  development  for  PDA  use  in  a 
classified  environment,  refer  to  CINCPACPET  Naval  Administrative  message  111813Z 
JUNOl. 

•  Software  downloads  should  have  as  their  source  government  or 
commercially  developed  apphcations,  or  those  developed  from  tmsted 
sources. 
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•  Only  upload  or  download  applications  when  physically  synced  with  a  host 
PC.  Wireless  or  infrared  downloads,  or  those  executed  directly  across  the 
network,  should  be  avoided. 

•  Due  to  the  wireless  susceptibihties  discussed  earher  in  this  chapter, 
synchronization  and  data  transmission  should  occur  either  physicahy  or 
via  infrared  until  such  a  time  as  wireless  transmission  weaknesses  are 
sufficiently  protected  against. 

•  Do  not  use  your  PDA  to  store  passwords,  combinations,  or  PINs 

•  PDAs  should  be  protected  with  antivirus  apphcations.  If  the  nature  of  the 
data  stored  on  the  device  is  sensitive  or  HIP  A  A- related,  additional 
measures  of  protection  (password/encryption)  should  be  taken. 

•  If  personal  PDAs  are  to  be  authorized  for  use  on  government  networks  or 
in  government  facihties,  they  should  conform  to  local  pohcy. 
Additionahy,  personal  devices,  if  used  outside  the  government  facihty, 
should  ensure  the  same  measure  of  protection  as  established  at  work. 

•  PDA  users  in  a  facihty  should  be  educated  as  to  local  pohcy,  and 
information  assurance  representatives  should  be  required  to  document  that 
education  be  having  the  user  sign  a  PDA  Use  Agreement. 

At  the  time  of  this  writing,  the  Naval  Medical  Information  Management  Center 
(NMIMC),  Bethesda,  MD  has  developed  a  draft  pohcy  on  the  use  of  Personal  Digital 
Assistants  in  the  form  of  a  BUMED  instmction.  That  instmction,  hsted  in  this  document 
as  Appendix  F,  contains  references  directly  affecting  the  pohcy  development.  The 
following  resources  are  also  provided. 


Information  Assurance  Resources 

Carnegie  Mehon  Software  Engineering  Institute 

Chief  of  Naval  Operations  (CNO  N6) 

Critical  Infrastmcture  Assurance  Office 

http  ://w  ww  .ciao .  gov 

Defense  Technical  Information  Center 

http://www.dtic.mil 

Elect  Information  Warfare  Center 

http://www.hwc.navv.mil 

Information  Technology  and  Operations  Center 

http  ://www  .itoc  .usma.edu 

Infosec  and  Infowar  Portal 

http://www.infowar.com 

Naval  Medical  Information  Management  Center 

http://navmedinfo.med.navv.mil 

Space  and  Naval  Warfare  Svstems  Command 

https://infosec.navv.mil 

Table  7.9.  Commercial  and  Governmental  Computer  Security  Resources. 
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J.  SUMMARY 

Prior  to  HIPAA,  security  was  one  of  the  key  elements  of  our  jobs.  With  a 
HIPAA-induced  emphasis,  network  and  data  security  have  become  the  key  elements. 
The  act,  while  defining  requirements  and  penalties,  does  not  specify  which  technologies 
will  fulfill  the  requirements.  With  the  known  insecurities  in  both  spread  spectmm 
transmissions  and  the  Wired  Equivalency  Privacy  encryption  protocol,  the  authors  feel 
that  neither  of  these  provides  an  adequate  measure  of  security  against  a  determined 
infiltrator. 

These  two  technologies  only  apply  toward  the  RF  wireless  transmission  of  patient 
data  (excluding  infrared).  Our  statement  reflecting  inadequacy  with  respect  to  HIPAA 
requirements  carries  only  until  an  acceptable  WEP  fix  or  replacement  protocol  is 
dehvered  to  the  industry. 

Until  then,  data  at  rest  protection  measures  need  to  be  pursued.  These  include  the 
measures  currently  taken  to  protect  our  networks,  but  now  must  also  be  extended  to  the 
use  of  PDAs.  Appendix  D,  the  BUMED  Draft  instmction  providing  PDA  guidance,  is  a 
good  place  to  start.  A  hybrid  solution  of  sufficiently  strong  access  passwords  plus 
sensitive  data  file  and  folder  encryption  is  a  necessity.  A  review  of  the  tables  in  this 
chapter  reflecting  implementation  guidance  to  fulfill  HIPAA  requirements  should  round 
out  a  facihty’s  PDA  pohcy  and  program  development. 
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vni.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  INTRODUCTION 

In  this  chapter  the  authors  summarize  the  previous  body  of  work,  and  provide 
conclusions  and  recommendations  based  on  the  research  conducted  and  presented  here. 
Areas  addressed  include  proven  private  sector  benefits  and  Military  Healthcare  System 
apphcability.  Also  presented  are  synopsized  findings  of  our  user- requirement  data 
search,  and  the  technically  focused  wireless  encryption  and  transmission  segments.  This 
is  followed  by  concerns  of  protecting  the  electronic  data  while  at  rest  on  the  PDA. 
Finally,  recommendations  for  future  research,  both  in  collaborating  with  governmental 
agencies  and  potential  focus  areas,  are  presented. 

B.  CONCLUSIONS 

1.  Private  Sector  Successes 

Physicians  in  the  private  sector  are  using  PDAs  to  enhance  chnical  and  business 
efficiencies  as  well  as  improving  the  quahty  of  care  dehvered.  Specific  uses  include; 
practice  management,  tracking  patients,  medication  dosage  and  chnical  score 
calculations,  reviewing  treatment  protocols  and  pharmaceutical  data,  prescription 
ordering,  insurance  verification,  patient  education,  coding,  and  patient  encounter 
documentation.  The  PDA  has  evolved  into  an  invaluable  decision  support  tool  that  saves 
hves,  reduces  costly  medical  and  prescription  errors,  and  increases  revenue  coUection. 

2.  Potential  Military  Healthcare  System  Applicability 

This  research  has  demonstrated  that  inexpensive  portable  digital  assistant 
technology  can  be  successfuUy  integrated  into  the  Mihtary  Healthcare  System  to  effect 
point-of-care  access  to  medical  reference  data,  patient  specific  data,  formularies, 
treatment  protocols,  and  billing/coding  information.  Dlustrated  was  the  lack  of  consistent 
high  data  quahty  and  provider  interaction  difficulties  with  mihtary  healthcare  information 
systems.  This  results  in  improper  accounting  of  medical  diagnoses  and  procedures  as  weh 
as  sub-optimal  third-party  cohection  efforts,  which  jeopardizes  JCAHO,  HIPAA 
comphance  and  Medicare  subvention,  and  adversely  affects  the  bottom  hne.  The  Mihtary 
Healthcare  System  can  reahze  the  same  business  and  clinical  enhancements  experienced 
by  private  sector  healthcare  organizations. 
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3.  Requirements  Analysis 

This  study  involved  detailed  analyses  of  data  collected  via  surveys,  literature 
research  and  personal  interviews.  Two  major  categories  of  information  have  been 
developed  using  the  analysis  tools:  Rank- ordered  user  requirements  based  upon  survey 
responses,  and  evaluation  of  hardware  devices  and  software  applications.  These  data  sets 
should  be  given  attention  by  activities  responsible  for  requirements  generation.  When 
identifying  initial  requirements  for  unit  capabihties,  attention  should  be  paid  to  Table  5.5, 
where  staff  members  have  identified  the  value  of  their  needs.  When  addressing  software 
solutions,  this  study  has  shown  it  is  necessary  to  ensure  applications  are  included  that 
support  each  of  the  five  major  categories:  Diagnosis  &  Treatment,  Medical  Calculators, 
Drug  Databases,  Patient  Tracking,  and  Coding.  With  respect  to  hardware  devices,  the 
iPAQ  Pocket  PC  system  was  the  unit  that  displayed  a  break  away  from  the  group. 
Several  personal  interviews  with  providers  have  shed  tight  on  an  aspect  of  hardware  not 
tested  during  this  study,  the  use  of  tablets.  Devices  such  as  the  Vadem  Clio  and  Sharp 
TriPad  have  display  areas  in  the  range  of  9  to  10  inches,  and  while  not  as  portable  as 
Palm  or  Pocket  PC  devices,  would  provide  software  engineers  interface  display  options 
not  available  to  PDAs.  Section  C  of  this  chapter  holds  recommendations. 

4.  Wireless 

The  two  most  popular  current  wireless  technologies,  802.11  and  802.11b,  are 
adequate  for  wireless  operations  in  many  industries.  However,  due  to  our  responsibility 
to  protect  patient  data,  HIPAA  requirements,  the  possibility  of  interception  of  wireless 
transmissions,  and  the  weaknesses  of  the  Wired  Equivalent  Privacy  protocol,  pursuit  of 
these  technologies  at  this  time  is  not  recommended.  This  is  not  to  say  that  no  wireless 
solution  should  be  pursued  quite  the  contrary,  in  fact.  Wireless  connectivity,  or  real-time 
access  to  the  enterprise  system  utilizing  PDAs  to  push  and  puU  patient  information,  is  one 
of  the  top  requirements  surveyed. 

5.  Security 

HIPAA  will  be  the  primary  driver  for  securing  electronic  data  in  the  healthcare 
field  for  the  next  several  years.  Chapter  Vn  discussed  the  legislative  impact,  and 
provided  guidance  on  establishing  organizational  plans  to  help  ntititary  treatment 
facilities  comply.  Chapter  VII  also  addressed  the  recently  identified  weaknesses  of  the 
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Wired  Equivalency  Privacy  encryption  protocol.  Activities  currently  operating  Spread 
Spectrum  technologies  using  this  industry-based  encryption  solutions  are  at  risk  of 
unauthorized  network  intmsion.  Vulnerabihties  also  exist  for  privacy  act- related  data  at 
rest  on  PDAs  if  steps  have  not  been  taken  to  increase  security  neasures  with  respect  to 
device  access  and  file  encryption. 

C.  RECOMMENDATIONS 

1.  Private  Sector  Partnering 

To  allow  for  continued  research  in  this  area,  Cooperative  Research  and 
Development  Agreements  (CRADAs)  should  be  estabhshed  between  government 
agencies  and  academic  institutions  with  leading  private  sector  healthcare  institutions, 
academic  institutions,  and  commercial  companies. 

2.  Potential  Military  Healthcare  System  Applicability 

Clearly,  the  Mihtary  Health  System  needs  to  embrace  this  technology  as  a  means 
to  reahze  its  vision  of  best  value  health  services.  The  Mihtary  Health  System  must 
eliminate  its  traditional  rehance  on  stovepipe  and  legacy  healthcare  information  systems. 
The  MHS,  unlike  commercial  healthcare  organizations,  is  not  driven  by  its  bottom  tine 
and  therefore  lacks  the  incentive  to  implement  technologies  that  increase  revenue.  The 
MHS  is  driven  by  a  need  to  dehver  care  that  supports  mihtary  personnel  readiness  within 
certain  budget  constraints.  Unfortunately,  these  budget  restrictions  impede  the  rapid 
adoption  of  the  latest  technologies.  The  MHS  must  reahze  that  the  utihty  of  a  PDA  is  one 
of  improving  the  quality  of  care  delivered,  supporting  readiness,  and  increasing  revenue 
collection  and  overcome  the  aforementioned  impediments. 

3.  Requirements  Analysis 

The  authors  recommendation  for  device  selection  is  a  hybrid  approach  based  upon 
functional  use.  A  provider  needing  to  access  a  great  number  of  CHCS-hke  pages  might 
be  served  equally  as  weh  by  a  tablet  as  an  iPAQ.  The  nursing  staff  and  chnical  support 
would  have  greatest  use  of  a  PDA,  while  if  the  device  was  shared  by  chnical  staff 
members  rather  than  personahy  assigned,  a  mggedized  version  such  as  the  Symbol 
solution  would  be  the  most  appropriate.  It  is  suggested  Tricare  Management  Activity 
(TMA)  not  only  address  the  user  requirements  specified  in  Chapter  V,  but  define  a 
multiple- platform  solution  in  their  request  for  proposal.  In  this  way  users  could,  much 
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like  the  seat- management  options  offered  by  Navy  and  Marine  Corps  Internet  (NMCI), 
select  a  hardware  solution  that  is  most  suited  for  the  function  being  performed. 

4.  Wireless 

Alternative  to  pursuit  of  FHSS  or  DSSS  solutions,  concurrent  pursuit  of  wireless 
solutions  that  utilizes  802.11a  is  recommended.  Recall  from  Chapter  VI  that  Coded 
Orthogonal  Frequency  Domain  Multiplexing  (COFDM)  operates  in  the  5.6  GHz 
spectmm,  avoiding  interference  with  many  2.4  GHz  technologies,  including  Bluetooth.  It 
also  offers  much  greater  data  transfer  rates — up  to  54  MB/sec.  While  hirly  new  to  the 
mainstream  wireless  arena,  availability  of  solutions  using  this  standard  is  expected  to 
grow  dramatically  over  the  next  12-18  months. 

In  addition,  continue  pursuing  technologies  that  utihze  Bluetooth  integration  of 
devices.  Featured  uses  such  as  certification  and  user  log-on  are  already  commonplace 
enabled  using  this  standard.  Additionally,  continue  pursuing  technologies,  which  utihze 
Infrared  interfaces.  Although  infrared  benefits  are  limited  in  functionahty,  especiaUy 
with  respect  to  real-time  or  on- demand  synchronization  (recaU  an  infrared  port  must  be 
readily  available),  the  standard  stiU  offers  several  advantages  including  low  infrastmcture 
cost  and  existing  market  saturation  in  devices.  Selection  of  infrared  solutions  should  be 
made  locaUy  based  on  need. 

5.  Security 

The  first  step  to  ensuring  sensitive  patient  data  in  electronic  format  is  protected  is 
a  strong  haison  between  an  organization's  Chief  Information  Officer  and  Privacy  Officer. 
Development  of  pohcy  and  educational  plans,  foUowed  by  the  actual  education  of  the 
staff  are  paramount.  HIPAA  compliance  deadlines  for  Transactions  and  Code  Sets  begin 
in  October  2002. 

With  respect  to  the  weaknesses  bom  out  in  the  Wired  Equivalent  Privacy  (WEP) 
encryption  protocol  for  wireless  transmissions,  the  industry  “fix”,  when  available,  must 
be  utihzed.  This  wiU  likely  be  either  an  actual  fix  to  the  inherent  weakness,  or  a  newly 
adapted  protocol.  Regardless,  the  encryption  protocol  eventually  used  should  be 
compatible  with  802.11a  wireless  standards,  the  recommended  wireless  solution  for 
mobile  enterprise  connectivity  of  PDAs,  tablets  and  laptops. 
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It  is  also  necessary  to  ensure  policy  exists  and  is  being  adhered  to  that  govern  the 
use  of  PDA  access.  Third-party  enhanced  password  protection  for  PDA  access  and  data 
encryption  for  any  privacy- related  data  stored  on  PDAs  should  be  a  requirement  in  any 
treatment  facihty. 

6.  Future  Research 

It  is  recommended  that  any  future  research  in  this  area  by  those  in  government 
outside  of  the  Naval  Postgraduate  School  begin  with  estabhshing  a  close  working 
relationship  with  several  organizations.  These  activities  include,  but  are  not  limited  to, 
the  first  three  hsted  in  the  following  Table  8.1.  Naval  Postgraduate  School  students  and 
staff  interested  in  research  grants  should  contact  Ms.  DanieUe  Kuska  hsted  below.  The 
benefits  to  leveraging  existing  efforts  which  are  seeking  to  integrate  similar  technologies 
cannot  be  overstated.  Additionally,  recommended  focus  areas  for  future  related  research 
are  provided  in  Table  8.2. 


_ PDA  Research  Points  of  Contact _ 

TRICARE  Management  Activity  (TMA)  -  Information  Management 
Major  Anthony  Inae  Skyline  5,  Suite  810 

anthonv.inae@tma.osd.mil  5111  Leesburg  Pike 

(703)  681-5611 _ Falls  Church,  VA  22041 _ 

Tri-Service  Infrastructure  Management  Program  Office  (TIMPO) 

CDR  Lyn  Hurd  Skyline  5,  Suite  810 

lvn.hurd@tma.osd.mil  5111  Leesburg  Pike 

(703)  399-2200  Falls  Church,  VA  22041 

_ Attn:  TIMPO _ 

Telemedicine  and  Advanced  Technology  Research  Center  (TATRC) 

Dr.  Rufus  Sessions 
sessions@tatrc.org 

(301)  619-4011 _ 

Space  and  Naval  Warfare  Systems  Command  (SPAWAR)  -  Research  Grants 

Ms.  Danielle  Kuska  (Local  POC)  1  University  Circle,  Code  91 

dkuska@nps.navv.mil  Monterey,  CA  93943-5207 

(831)  656-2099 _ 


Table  8.1.  Contact  List  for  Future  Research  Initiatives. 
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_ Related  Future  Research  Areas _ 

Use  of  PDAs  for  administration  of  medication  dispensing _ 

Use  of  PDAs  for  disease  management _ 

Use  of  PDAs  for  medical  inventory  management 

User  interface  application  development  for  integration  with  the  enterprise  system _ 

Use  of  802.1  la  connecting  technologies  for  mobile  platforms 

Use  of  Bluetooth  connecting  technologies  for  development  of  medical 

piconetworks _ 

Use  of  mggedized  PDAs  for  shipboard,  submarine,  and  field  apphcations 

Navy  medicine  concerns  regarding  wireless  transmission  interference  with  other 

medical  telemetry  devices 

PDA  support  for  DoD  Common  Access  Cards  for  Wireless  LAN  access _ 

PDA  Thin  Ghent  Applications _ 


Table  8.2.  Recommended  Focus  Areas  for  Future  PDA- Related  Healthcare  Research. 

D.  SUMMARY 

This  chapter  provided  a  synopsis  of  conclusions  based  upon  work  conducted 
throughout  the  thesis  period.  Significant  areas  covered  included:  private  sector 
apphcations,  potential  business  apphcabihty  within  the  Department  of  Defense  Mihtary 
Health  System,  research  analysis  of  user  requirements,  technology- focused  areas  of 
wireless  data  encryption  and  transmission,  and  legislative  drivers  in  the  form  of  HIPAA. 
Recommendations  covering  those  specific  topics  were  also  presented.  Finally, 
recommendations  were  given  for  future  research  addressing  PDA  integration,  both  with 
respect  to  existing  agency  sources  of  information,  and  to  specific  focus  areas  of  potential 
benefit  to  DoD  healthcare. 
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APPENDIX  A.  TABULAR  REPRESENTATION  OE  USER 
REQUIREMENT  SURVEY  DATA  BY  POSITION 


This  appendix  provides  a  comprehensive  tabulation  of  aU  online  survey 
responses.  The  data  is  given  in  the  same  order  as  the  questions  were  presented  in  the 
survey,  and  user  responses  have  been  compiled  by  the  respondent’s  position  within  their 
organization. 

Ql.  The  value  of  using  Personal  Digital  Assistant  technology  (Palm  Pilot, 
Pocket  PC,  et  al)  to  input  data  to/extract  data  from  the  Composite  Health  Care 
System  and/or  the  Ambulatory  Data  System: 


Position 

!  ’  High 

L  Med 

Low 

1  co/xo 

1 _ ^ _ u 

1  3 

1 _ 

1  Director  (DCS,  DFA,  DNS) 

1  16 

i  4 

1 

1  Provider 

1  119 

36 

10 

1  Nursing  Specialist 

13 

6 

1  Comptroller/Billing/Claims 

1 

2 

1 

1  MIS  Head/CIO 

1  7 

1  2 

1 

1  Patient  Administration 

13 

6 

1 

1  Provider  Support  (Clinician) 

1  18 

1  9 

1  7 

1  Total: 

190 

68 

19 

277  1 

Q2.  The  value  of  using  PDAs  where  you  must  return  the  device  to  a  cradle  or 
use  infrared  sync  station  to  update  either  the  PDA  or  CHCS/ADS  is 


1  Position 

High 

Med 

Low 

CO/XO 

i  4 

1  1 

1 

1  Director  (DCS,  DFA,  DNS) 

15 

5 

1  Provider 

87 

65 

13 

1  Nursing  Specialist 

8 

6 

5 

1  Comptroller/Billing/Claims 

2 

2 

1  MIS  Head/CIO 

1  2 

1 

1  3 

1  Patient  Administration 

12 

7 

1 

1  Provider  Support  (Clinician) 

18 

9 

7 

1  Total: 

148 

99 

30 

277 

97 


Q3.  The  value  of  using  PDAs  in  an  environment  where  a  wireless  connection 
to  a  LAN  provides  continuous,  real-time  data  is 


1  Position 

High 

1  Med 

Low 

,  co/xo 

1  6 

! 

1  Director  (DCS,  DFA,  DNS) 

17 

1  3 

J 

1  Provider 

144 

1  16 

1  5 

1  Nursing  Specialist 

15 

3 

1 

1  Comptroller/Billing/Claims 

1 

1 

1 

1  MIS  Head/CIO 

9 

1  Patient  Administration 

18 

1 

1 

1  Provider  Support  (Clinician) 

23 

5 

6 

1  Total: 

236 

28 

13 

277 

Q4.  The  value  of  using  PDAs  for  Pharmaceutical  Order  Entry  is 


Position 

:  High 

Med 

Low 

1  CO/XO 

1  5 

1 

1 

1  Director  (DCS,  DFA,  DNS) 

16 

J  4 

1 

1  Provider 

1  121 

25 

19 

1  Nursing  Specialist 

12 

3 

4 

1  Comptroller/Billing/Claims 

1  3 

1 

1 

1  MIS  Head/CIO 

7 

2 

1  Patient  Administration 

1  14 

1 

1  2 

1  Provider  Support  (Clinician) 

17 

6 

11 

1  Total: 

195 

44 

38 

277 

Q5.  The  value  of  using  PDAs  for  Laboratory  Order  Entry  is 


Position 

High 

Med 

Low 

1  CO/XO 

L _ iJ 

1  1| 

1  Director  (DCS,  DFA,  DNS) 

1  IV 

1  3 

1 

1  Provider 

1  119 

27 

19 

1  Nursing  Specialist 

12 

5 

2 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

6 

3 

1  Patient  Administration 

1  14 

1  2 

1 

1  Provider  Support  (Clinician) 

18 

7 

9 

1  Total: 

1  193 

1  48 

1  36 

277 

98 


Q6.  The  value  of  using  PDAs  for  Radiological  Order  Entry  is 


'  Position 

High 

Med 

Low 

,  co/xo 

1  3 

1 _ ^ 

1 

1  Director  (DCS,  DFA,  DNS) 

17 

1  3 

1  Provider 

1  123 

22 

20 

1  Nursing  Specialist 

12 

5 

2 

1  Conptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

1  6 

1  2 

1 

1  Patient  Administration 

15 

2 

3 

1  Provider  Support  (Clinician) 

20 

5 

9 

1  Total: 

199 

41 

37 

277 

Q7.  The  value  of  using  PDAs  to  look  up  ICD-9/CPT  /PDR  is 


*  Position 

High 

Med 

Low 

1  CO/XO 

1  6 

J 

1  Director  (DCS,  DFA,  DNS) 

18 

1  2 

i 

1  Provider 

]  122 

1  24 

1  19 

1  Nursing  Specialist 

14 

3 

2 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

6 

2 

1 

1  Patient  Administration 

16 

3 

1 

1  Provider  Support  (Clinician) 

1  21 

1  8 

1  5 

1  Total: 

206 

42 

29 

277 

Q8.  The  value  of  using  PDAs  to  reduce/or  eliminate  KG-ADS  terminal  use 

time  is 


^  Position 

^  High  ^ 

t  Med 

Low 

,  CO/XO 

3 

3 

1  Director  (DCS,  DFA,  DNS) 

1  17 

!  1 

i  2 

1  Provider 

121 

25 

19 

1  Nursing  Specialist 

14 

3 

2 

1  Comptroller/Billing/Claims 

1  3 

1 

1 

1  MIS  Head/CIO 

6 

2 

1 

1  Patient  Administration 

1  16 

1  3 

1 

1  Provider  Support  (Clinician) 

24 

1 

9 

1  Total: 

204 

39 

34 

277 

99 


Q9.  The  value  of  using  PDAs  to  provide  billing  info  directly  to  billing  dept  is 


1  Position 

:  High 

r"  ’  Med 

Low 

"co/xo 

1  5 

! 

1 

1  Director  (DCS,  DFA,  DNS) 

1  15 

1  4 

1  1| 

1  Provider 

1  86 

35 

44 

1  Nursing  Specialist 

1 

1  5 

1  3 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

6 

1 

2 

1  Patient  Administration 

15 

2 

3 

1  Provider  Support  (Clinician) 

19 

7 

8 

1  Total: 

1  160 

1  55 

1  62 

277 

QIO.  The  value  of  using  PDAs  to  search  professional  literature  (e.g.,  AMA 
abstracts,  Epocrates,  et  al)  is 


High 

i  Med 

Low 

1  4 

_ 

2 

16 

4 

1  Provider 

J  124 

27 

14 

1  Nursing  Specialist 

14 

3 

2 

1  Comptroller/Billing/Claims 

1 

1 

2 

1  MIS  Head/CIO 

1  6 

1 

1  2 

1  Patient  Administration 

17 

1 

2 

1  Provider  Support  (Clinician) 

20 

8 

6 

1  Total: 

202 

45 

30 

277 

Qll.  The  value  of  using  PDAs  for  e-mail  connectivity  is: 


'  Position 

L  High 

L  'Hed 

Low 

1  co/xo 

2 

1  2 

1  2 

1  Director  (DCS,  DFA,  DNS) 

1  16 

1  3 

i  1 

1  Provider 

]  97 

1  40 

1  28 

1  Nursing  Specialist 

12 

5 

2 

1  Comptroller/Billing/Claims 

2 

2 

1  MIS  Head/CIO 

4 

2 

3 

1  Patient  Administration 

16 

1 

3 

1  Provider  Support  (Clinician) 

1  22 

1  9 

1  3 

1  Total: 

171 

62 

44 

277 

100 


Q12.  The  value  of  using  PDAs  to  reduce  medical  errors  (drug  interaction 
warnings,  dosage  calculators,  etc)  is 


1  Position 

High 

i  Med 

Low 

,  co/xo 

1 

1  Director  (DCS,  DFA,  DNS) 

19 

1  1 

1  Provider 

1  142 

1  13 

1  Nursing  Specialist 

18 

1 

1  Comptroller/Billing/Claims 

1 

1 

1 

1  MIS  Head/CIO 

7 

2 

2 

1  Patient  Administration 

18 

1  Provider  Support  (Clinician) 

25 

6 

3 

1  Total: 

238 

24 

15 

277 

Q13.  The  value  of  using  PDAs  for  personal  and  patient  scheduling  is 


1^  Position 

High 

Med 

Low 

CO/XO 

1  4 

1  2 

1  Director  (DCS,  DFA,  DNS) 

1  17 

1  3 

1 

1  Provider 

1  121 

31 

13 

1  Nursing  Specialist 

13 

3 

3 

1  Comptroller/Billing/Claims 

2 

1 

1 

1  MIS  Head/CIO 

1  7 

1 

1 

1  Patient  Administration 

17 

1 

2 

1  Provider  Support  (Clinician) 

1  22 

1  8 

1 

1  Total: 

203 

50 

24 

277 

Q14.  With  respect  to  PDAs,  cost  concerns  are 


1  Position 

High 

Med 

Low 

CO/XO 

2 

2 

I  2 

1  Director  (DCS,  DFA,  DNS) 

4 

1  12 

1  4 

1  Provider 

55 

68 

42 

1  Nursing  Specialist 

10 

6 

3 

1  Comptroller/Billing/Claims 

2 

1 

1 

1  MIS  Head/CIO 

3 

4 

2 

1  Patient  Administration 

1 

1  6 

1  3 

1  Provider  Support  (Clinician) 

12 

13 

9 

1  Total: 

1  99 

1  112 

1  66 

277 

101 


Q15.  With  respect  to  PDAs,  network  security  concerns  are 


High 

Med 

Low 

1  3 

1  2 

1 

15 

1  4 

i  1 

1  Provider 

1  96 

47 

22 

1  Nursing  Specialist 

12 

7 

1  Comptroller/Billing/Claims 

4 

1  MIS  Head/CIO 

1  7 

1  2 

1 

1  Patient  Administration 

16 

2 

2 

1  Provider  Support  (Clinician) 

25 

3 

6 

1  Total: 

178 

67 

32 

277 

Q16.  With  respect  to  PDAs,  patient  privacy  (HIPAA)  concerns  are 


Position 

;  High 

j  Med 

Low 

1  co/xo 

2 

2 

2 

1  Director  (DCS,  DFA,  DNS) 

15 

1  4 

1  1 

1  Provider 

1  109 

29 

27 

1  Nursing  Specialist 

15 

4 

1  Comptroller/Billing/Claims 

1 

1 

1 

1  MIS  Head/CIO 

7 

2 

1  Patient  Administration 

15 

3 

2 

1  Provider  Support  (Clinician) 

27 

2 

5 

1  Total: 

194 

46 

37 

277 

Q17.  With  respect  to  PDAs,  ease  of  use  concerns  are 


1  Position 

!_  High 

i  Med 

Low 

CO/XO 

1  2 

1  3 

1 

1  Director  (DCS,  DFA,  DNS) 

11 

5 

4 

1  Provider 

no 

34 

21 

1  Nursing  Specialist 

11 

5 

3 

1  Comptroller/Billing/Claims 

4 

1  MIS  Head/CIO 

1 

1  2 

1 

1  Patient  Administration 

15 

2 

3 

1  Provider  Support  (Clinician) 

20 

7 

7 

1  Total: 

179 

58 

40 

277 

102 


Q18.  With  respect  to  PDAs,  the  ability  to  personalize  content  are 


'  Position 

High 

Med 

Low 

,  co/xo 

!  3 

1 _ LJ 

2 

1  Director  (DCS,  DFA,  DNS) 

10 

1  10 

1  Provider 

1  121 

32 

12 

1  Nursing  Specialist 

12 

5 

2 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

1  5 

1 

1  3 

1  Patient  Administration 

12 

4 

4 

1  Provider  Support  (Clinician) 

20 

10 

4 

1  Total: 

186 

63 

28 

277 

Q19.  With  respect  to  PDAs,  limited  application  storage  (internal  RAM) 
concerns  are 


1  Position 

High 

Med 

Low 

CO/XO 

■ 

1  2 

j  2 

J  2 

1  Director  (DCS,  DFA,  DNS) 

1  15 

4 

1 

1  Provider 

1  121 

1  39 

1  5 

1  Nursing  Specialist 

14 

4 

1 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

4 

5 

1  Patient  Administration 

16 

2 

2 

1  Provider  Support  (Clinician) 

1  19 

1  9 

1  6 

1  Total: 

194 

66 

17 

277 

Q20.  With  respect  to  PDAs,  a  color  display  is  important 


Position 

High 

Med 

Low 

CO/XO 

1  1 

5 

1  Director  (DCS,  DFA,  DNS) 

6 

1  9 

\  5| 

1  Provider 

]  55 

53 

57 

1  Nursing  Specialist 

1  5 

1  5 

1  9 

1  Comptroller/Billing/Claims 

2 

2 

1  MIS  Head/CIO 

3 

2 

4 

1  Patient  Administration 

10 

4 

6 

1  Provider  Support  (Clinician) 

11 

9 

14 

1  Total: 

1  92 

1  85 

1  100 

277 

103 


Q21.  With  respect  to  PDAs,  additional  functionality  (use  as  a  voice  recorder, 
beeper,  etc.)  is 


1  Position 

High 

Med 

Low 

1  co/xo 

3 

3 

1  Director  (DCS,  DFA,  DNS) 

13 

4 

3 

1  Provider 

1  89 

1  54 

1  22 

1  Nursing  Specialist 

7 

7 

5 

1  Comptroller/Billing/Claims 

1  2 

1 

1  2 

1  MIS  Head/CIO 

4 

4 

1 

1  Patient  Administration 

15 

2 

3 

1  Provider  Support  (Clinician) 

17 

10 

7 

1  Total: 

147 

84 

46 

277 

Q22.  The  value  of  point -of-service  patient  registration/admission  with  the 

PDA  is 


1  Position 

1  High 

1  Med 

Low 

1  CO/XO 

3 

1 

2 

1  Director  (DCS,  DFA,  DNS) 

13 

7 

1  Provider 

89 

38 

38 

1  Nursing  Specialist 

13 

3 

3 

1  Comptroller/Billing/Claims 

1  2 

1 

1 

1  MIS  Head/CIO 

5 

1 

3 

1  Patient  Administration 

14 

6 

1  Provider  Support  (Clinician) 

18 

6 

10 

1  Total: 

157 

57 

63 

277 

Q23.  The  value  of  a  portable  (pocket  sized)  PDA  is 


1  Position 

High 

Med 

Low 

1  CO/XO 

5 

1 

1  Director  (DCS,  DFA,  DNS) 

20 

1 

1 

1  Provider 

157 

7 

1 

1  Nursing  Specialist 

15 

4 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

8 

1 

1  Patient  Administration 

1  IV 

1  2 

1 

1  Provider  Support  (Clinician) 

26 

5 

3 

1  Total: 

251 

21 

5 

277 

104 


Q24.  The  value  of  medical  records  integration/access  with  a  PDA  is 


'  Position 

High 

Med 

Low  ' 

,  co/xo 

1  3 

1 _ ^ 

1  Director  (DCS,  DFA,  DNS) 

1  16 

1  3 

i  1 

1  Provider 

125 

32 

8 

1  Nursing  Specialist 

14 

4 

1 

1  Comptroller/Billing/Claims 

2 

2 

1  MIS  Head/CIO 

1  5 

1 

1 

1  Patient  Administration 

15 

2 

3 

1  Provider  Support  (Clinician) 

22 

4 

8 

1  Total: 

202 

52 

23 

277 

Q25.  The  \alue  of  accessing  patient  information  at  the  point  of  patient  care 
with  a  PDA  is 


Position 

i  High 

i  Med 

Low 

CO/XO 

I  5 

UL _ 

1 

,  Director  (DCS,  DFA,  DNS) 

19 

li 

i _  1 

1  Provider 

1  139 

|18 

fs  i 

1  Nursing  Specialist 

16 

1 

2  1 

1  Comptroller/Billing/Claims 

3 

1  1 

1  MIS  Head/CIO 

6 

3 

1  Patient  Administration 

16 

1 

3  1 

1  Provider  Support  (Clinician) 

|21 

F 

|9  1 

1  Total: 

225 

29 

23  1 

277  1 

Q26.  The  value  of  standardized  medical/business  applications  on  the  PDA  is 


'  Position 

High 

Med 

Low 

1  CO/XO 

6 

1 

1  Director  (DCS,  DFA,  DNS) 

18 

1  2 

1  Provider 

1  129 

1  26 

1  10 

1  Nursing  Specialist 

18 

1 

1  Comptroller/Billing/Claims 

1  3 

1 

1 

1  MIS  Head/CIO 

6 

3 

1  Patient  Administration 

18 

2 

1  Provider  Support  (Clinician) 

26 

4 

4 

1  Total: 

224 

36 

17 

277 

105 


Q27.  The  minimum  PDA  delay  in  screen  response  time  that  is  acceptable  is 


1  Position 

1-5 

seconds 

6-10 

seconds 

10-1- 

seconds 

1  co/xo 

4 

2 

1  Director  (DCS,  DFA,  DNS) 

19 

1 

r 

1 

1  Provider 

136 

29 

1  Nursing  Specialist 

11 

6 

2 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

8 

1 

1  Patient  Administration 

14 

5 

1 

1  Provider  Support  (Clinician) 

27 

6 

1 

1  Total: 

222 

51 

4 

277 

Q28.  The  number  of  acceptable  screen  interactions  (scrolls)  until  desired 
information  is  located  is 


1 _  Position 

'  1-3  scrolls 

4-6  scrolls 

7-1-  scrolls 

CO/XO 

1  2 

1 

1  Director  (DCS,  DFA,  DNS) 

4 

1  Provider 

138 

27 

1  Nursing  Specialist 

18 

1 

1  Comptroller/Billing/Claims 

3 

1 

1  MIS  Head/CIO 

8 

1 

1  Patient  Administration 

1  16 

1  3 

1 

1  Provider  Support  (Clinician) 

27 

6 

1 

1  Total: 

1  230 

1  45 

1  2 

277 

Q29.  The  minimum  acceptable  battery  life  between  charges  is 


Position 

0-4  hours 
(duration 
of  rounds) 

1 

5-8 

hours 

(one 

shift) 

■ 

12+ 

hours 

CO/XO 

3 

2 

1 

Director  (DCS,  DFA,  DNS) 

3 

2 

10 

_ 

Provider 

35 

44 

34 

52 

Nursing  Specialist 

3 

8 

5 

3 

Comptroller/Billing/Claims 

2 

2 

MIS  Head/CIO 

4 

3 

1 

1 

Patient  Administration 

6 

3 

8 

3 

Provider  Support  (Clinician) 

6 

14 

8 

6 

Total: 

59 

79 

68 

71 

277 

106 


Q30.  Currently,  are  you  confident  that  CHCS  II  and  KG-ADS  patient 
specific  data  is  accurate 


1  Position 

Yes 

1  No  I 

,  co/xo 

1  2 

J  4 

1  Director  (DCS,  DFA,  DNS) 

i  8 

1  12 

1  Provider 

1  105 

1  59 

1  Nursing  Specialist 

16 

3 

1  Comptroller/Billing/Claims 

1  3 

1 

1  MIS  Head/CIO 

3 

6 

1  Patient  Administration 

15 

5 

1  Provider  Support  (Clinician) 

24 

10 

Total: 

176 

100 

276  1 

Q3I.  Are  you  frustrated  with  CHCS  11  and  KG-ADS  integration/operahility 


Position 

Yes 

[  No  :j 

1  CO/XO 

1  3 

1  Director  (DCS,  DFA,  DNS) 

16 

4 

1  Provider 

139 

25 

1  Nursing  Specialist 

15 

4 

1  Comptroller/Billing/Claims 

1  2 

1  2 

1  MIS  Head/CIO 

6 

3 

1  Patient  Administration 

1  14 

1  6 

1  Provider  Support  (Clinician) 

20 

14 

1  Total: 

215 

61 

276  1 

Q32.  How  long  does  it  require  to  locate/input  desired  information  (ICD- 
9/CPT  codes)  into  CHCS  II  and  KG-ADS 


Position 

1-5 

seconds 

6-10 

seconds 

11-15 

seconds 

16-20 

seconds 

20-1- 

seconds 

fco/xo 

1 

2 

! _ U 

L _ ^ 

1  2 

1  Director  (DCS,  DFA,  DNS) 

8 

3 

1 

2 

6 

1  Provider 

49 

19 

18 

16 

62 

1  Nursing  Specialist 

1 

2 

4 

5 

5 

1  Comptroller/Billing/Claims 

4 

0 

0 

0 

0 

1  MIS  Head/CIO 

2 

1 

3 

1 

2 

1  Patient  Administration 

8 

4 

3 

3 

2 

1  Provider  Support  (Clinician) 

15 

3 

4 

1 

11 

1  Total: 

88 

34 

34 

28 

90 

274 

*  Q33-Q35  have  significantly  fewer  responses.  These  questions  were  added  based  upon  Delphi  roundtable 
sessions  with  providers  at  Naval  Hospital  Lemoore  after  they  had  taken  the  survey,  and  thus  do  not  reflect 
their  answers. 
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Q33.  The  value  of  integrating  voice  transcription  services  on  the  PDA  is 


1  Position 

'  iiigh 

(  Med 

Low 

.  co/xo 

l_  3 

1 

1  2 

1  Director  (DCS,  DFA,  DNS) 

!  16 

2 

1 

1  Provider 

J  93 

24 

34 

1  Nursing  Specialist 

9 

3 

5 

1  Comptroller/Billing/Claims 

2 

1 

1  MIS  Head/CIO 

4 

3 

2 

1  Patient  Administration 

1  8 

1  2 

1  3 

1  Provider  Support  (Clinician) 

15 

10 

9 

1  Total: 

1  150 

1  45 

1  57 

252  1 

Q34.  The  value  of  providing  an  audio  alert  for  high-priority  e-mail  on  the 

PDA  is 


Position 

High 

Med 

Low 

1  CO/XO 

i  3 

1  2 

1 

1  Director  (DCS,  DFA,  DNS) 

15 

1  3 

1  1 

1  Provider 

J  75 

36 

40 

1  Nursing  Specialist 

9 

7 

1 

1  Comptroller/Billing/Claims 

1  2 

1 

1 

1  MIS  Head/CIO 

4 

5 

1  Patient  Administration 

1  8 

1  3 

1  2 

1  Provider  Support  (Clinician) 

13 

12 

9 

1  Total: 

129 

68 

55 

252 

Q35.  The  value  of  integrating  barcode  scanning  capability  (match 
medications  with  patient,  associate  material  costs  with  episodes  of  care/inventory 
control)  on  the  PDA  is 


Position 

High 

'  Med 

Low 

1  CO/XO 

5 

1 

1 

1  Director  (DCS,  DFA,  DNS) 

1  ’  13 

1  4 

1  2 

1  Provider 

i  88 

28 

35 

1  Nursing  Specialist 

14 

3 

1  Comptroller/Billing/Claims 

2 

1 

1  MIS  Head/CIO 

3 

4 

2 

1  Patient  Administration 

1  8 

1  3 

1  2 

1  Provider  Support  (Clinician) 

21 

6 

7 

1  Total: 

1  154 

1  49 

1  49 

1  252 
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Q36.  The  value  of  utilizing  medical  imaging  (low-level  diagnostic  display 
capability)  on  the  PDA  is 


1  Position 

High 

j  Med 

Low 

,  co/xo 

2 

1 

4|;| 

1  Director  (DCS,  DFA,  DNS) 

8 

1  6 

J  6 

1  Provider 

J  78 

1  35 

1  52 

1  Nursing  Specialist 

10 

5 

4 

1  Comptroller/Billing/Claims 

1  2 

1 

1  2 

1  MIS  Head/CIO 

2 

2 

5 

1  Patient  Administration 

12 

3 

5 

1  Provider  Support  (Clinician) 

15 

5 

14 

1  Total: 

129 

56 

92 

277 
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APPENDIX  B.  STATISTICAL  ANALYSIS  IN  SUPPORT  OF 
REQUIREMENTS  GENERATION 


This  appendix  provides  the  statistical  analyses  that  were  performed  on  the  on-line 
User  Requirement  Survey  data.  The  primary  methodology  used  is  the  Chi-Square  test. 
Chi-Square  hypothesis  testing  provides  the  premise  that  in  a  random  distribution,  the 
expected  number  of  responses  would  be  divided  equally  among  the  response  choices 
(nuU  hypothesis).  If  the  test  concludes  that  the  nuU  hypothesis  should  be  rejected,  the 
assumption  is  made  that  there  is  significance  to  a  user’s  response  or  responses.  The 
software  used  to  analyze  this  data  set  is  Microsoft  Excel  2000  and  Prentice  Hall’s  PHStat 
97  for  Excel. 

**NOTE:  Throughout  this  appendix,  as  the  p-value  approaches  zero  in  the  Chi- 
Square  test,  the  Chi-Square  test  statistic  may  appear  as  #NUM!  due  to  a  Microsoft  Excel 
bug.  This  phenomena  in  no  way  interferes  with  the  test  result  to  accept  or  reject  the  nuU 
hypothesis. 

Additionally,  weighted  mean  data  is  provided  where  appropriate,  with  a  visual 
Liker  scale  representation.  Descriptive  statistics,  while  not  used  specifically  in  this 
study,  are  provided  for  any  future  analysis. 
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Ql.  The  value  of  using  Personal  Digital  Assistant  technology  (Palm  Pilot,  Pocket  PC, 
et  al)  to  input  data  to/extract  data  from  the  Composite  Health  Care  System  and/or  the 
Ambulatory  Data  System: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  iVfed 

Low 

Total 

Actual  Count  190  68 

19 

277 

Total 

190  68 

19 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.469314 

Degrees  of  Freedom  2 

Standard  Error 

0.147131 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  3.36E-37 

Standard  Deviation 

2.448742 

Hq:  There  is  no  preference  shown 

Sample  Variance 

5.99633S 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.762143 

Reject  the  null  hypothesis 

Skewness 

-1.36372 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2065 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.289641 

Ql 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

190 

9 

1710 

Medium 

68 

5 

340 

Low 

19 

1 

19 

277 

2069 

7.47 
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Q2.  The  value  of  using  PDAs  where  you  must  return  the  device  to 
infrared  sync  station  to  update  either  the  PDA  or  CHCS/ADS  is: 

a  cradle 

or  use 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable 

Hlgb  Med 

Low 

Total 

Actual  Count 

148  99 

30 

277 

Total 

148  99 

30 

277 

Expected  Frequencies: 

Column  variable 

Row  variable 

High  Med 

Low 

Total 

Expected  Count 

92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.703971 

Degrees  of  Freedom  2 

Standard  Error 

0.1635 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p- Value  2.95E-17 

Standard  Deviation 

2.721177 

Hq:  There  is  no  preference  shown 

Sample  Variance 

7.404803 

Ha:  There  is  a  preference  shown 

Kurtosis 

-0.55421 

Reject  the  null  hypothesis 

Skewness 

-0.77263 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

1857 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.321865 

Q2 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

148 

9 

1332 

Medium 

99 

5 

495 

Low 

30 

1 

30 

277 

1857 

6.70 

I — I — ^ ^ ^ — I 

123  456  789 


113 


Q3.  The  value  of  using  PDAs  in  an  environment  where  a  wreless  connection  to  a  LAN 
provides  continuous,  real-time  data  is: _ 

Chi-Square  Test 

Observed  Frequencies:  Column  variable 

Row  variable  Hlgb  Med  Low  Total 

Actual  Count  236  28  13  277 

Total_ 236_ 28_ 13_ m 

Expected  Frequencies:  Column  variable 

Row  variable  High  Med  Low  Total 

Expected  Count  92.33  92.33  92.33  216.% 

Total  92.33  92.33  92.33  216.% 


Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

8.220217 

Degrees  of  Freedom  2 

Standard  Error 

0.12057C 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  8.35E-74 

Standard  Deviation 

2.006842 

Hq:  There  is  no  preference  shown 

Sample  Variance 

4.02741f 

Ha:  There  is  a  preference  shown 

Kurtosis 

5.73973c 

Reject  the  null  hypothesis 

Skewness 

-2.581  If 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2277 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.237372 

Q3 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

236 

9 

2124 

Medium 

28 

5 

140 

Low 

13 

1 

13 

277 

2277 

8.22 

_  A 

ZA 

123  456  789 
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04.  The  value  of  using  PDAs  for  Pharmaceutical  Order  Entry  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  195  44 

38 

277 

Total 

195  44 

38 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.267 14J 

Degrees  of  Freedom  2 

Standard  Error 

0.173608 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  5.93E-38 

Standard  Deviation 

2.889405 

Hq:  There  is  no  preference  shown 

Sample  Variance 

8.348663 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.236584 

Reject  the  null  hypothesis 

Skewness 

-1.33923 

At  the  .05  level  of  significance  we 

Range 

8 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2013 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.341763 

Q4 

Survey  Responses 

Weight 

Weighted  value 

Weighted 

average 

High 

195 

9 

1755 

Medium 

44 

5 

220 

Low 

38 

1 

38 

277 

2013 

7.27 

1 


2 


3 


4 


5 


6 


8 


9 
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05.  The  value  of  using  PDAs  for  Laboratory  Order  Entry  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  Hlgb  Med 

Low 

Total 

Actual  Count  193  48 

36 

277 

Total 

193  48 

36 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.267 14J 

Degrees  of  Freedom  2 

Standard  Error 

0.1711S 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  1.2E-36 

Standard  Deviation 

2.84899f 

Ho:  There  is  no  preference  shown 

Sample  Variance 

8.11677C 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.25757f 

Reject  the  null  hypothesis 

Skewness 

-1.32832 

At  the  .05  level  of  significance  we 

Range 

8 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2013 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.336984 

Q5 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

193 

9 

1737 

Medium 

48 

5 

240 

Low 

36 

1 

36 

277 

2013 

7.27 

1 


2 


3 


4 


5 


6 


8 


9 
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06.  The  value  of  using  PDAs  for  Radiological  Order  Entry  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  Hlgb  Med 

Low 

Total 

Actual  Count  199  41 

37 

277 

Total 

199  41 

37 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  5 

Mean 

7.33935 

Degrees  of  Freedom  2 

Standard  Error 

0.171937 

Critical  Value  5.99147f 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  6.96E41 

Standard  Deviation 

2.861602 

Hq:  There  is  no  preference  shown 

Sample  Variance 

8.188772 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.418197 

Reject  the  null  hypothesis 

Skewness 

-1.4078f 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2033 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.338475 

Q6 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

199 

9 

1791 

Medium 

41 

5 

205 

Low 

37 

1 

37 

277 

2033 

7.34 

1 


2 


3 


4 


5 


6 


8 


9 
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07.  The  value  of  using  PDAs  to  look  up  ICD-9/CPT  /PDR  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  206  42 

29 

277 

Total 

206  42 

29 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.555957 

Degrees  of  Freedom  2 

Standard  Error 

0.159722 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  1.67E-46 

Standard  Deviation 

2.65830f 

Ho:  There  is  no  preference  shown 

Sample  Variance 

7.066604 

Ha:  There  is  a  preference  shown 

Kurtosis 

1.13884C 

Reject  the  null  hypothesis 

Skewness 

-1.6032C 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2093 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.31442C 

Q7 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

206 

9 

1854 

Medium 

42 

5 

210 

Low 

29 

1 

29 

277 

2093 

7.56 

1 


2 


3 


4 


5 


6 


7 


9 
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08.  The  value  of  using  PDAs  to  reduce/or  eliminate  KG-ADS  terminal  use  time  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  204  39 

34 

111 

Total 

204  39 

34 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.454874 

Degrees  of  Freedom  2 

Standard  Error 

0.167255 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  9.57E-45 

Standard  Deviation 

2.78367J 

Hq:  There  is  no  preference  shown 

Sample  Variance 

7.748862 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.76603f 

Reject  the  null  hypothesis 

Skewness 

-1.51741 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2065 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.32925J 

Q8 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

204 

9 

1836 

Medium 

39 

5 

195 

Low 

34 

1 

34 

277 

2065 

7.45 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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Q9.  The  value  of  using  PDAs  to  provide  billing  info  directly  to  billing  department  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  Hlgb  Med 

Low 

Total 

Actual  Count  160  55 

62 

111 

Total 

160  55 

62 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.415162 

Degrees  of  Freedom  2 

Standard  Error 

0.198001 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p- Value  6.16E-17 

Standard  Deviation 

3.295394 

Hq:  There  is  no  preference  shown 

Sample  Variance 

10.85962 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.1277f 

Reject  the  null  hypothesis 

Skewness 

-0.73812 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

1777 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.389784 

Q9 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

160 

9 

1440 

Medium 

55 

5 

275 

Low 

62 

1 

62 

277 

1777 

6.42 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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QIO.  The  value  of  using  PDAs  to  search  professional  literature  (e.g., 
Epocrates,  et  al)  is: 

AMA  abstracts, 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  202  45 

30 

277 

Total 

202  45 

30 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  o  f  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.33935 

Degrees  of  Freedom  2 

Standard  Error 

0.175551 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  2.03E-43 

Standard  Deviation 

2.92174f 

Hq:  There  is  no  preference  shown 

Sample  Variance 

8.53659S 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.38091 

Reject  the  null  hypothesis 

Skewness 

-1.421; 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2033 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.345585 

QIO 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

202 

9 

1818 

Medium 

45 

5 

225 

Low 

30 

1 

30 

277 

2073 

7.48 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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Oil.  The  value  of  using  PDAs  for 

e-mail  connectivity  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  17 1  62 

44 

277 

Total 

171  62 

44 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.833935 

Degrees  of  Freedom  2 

Standard  Error 

0.181134 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  6.13E-23 

Standard  Deviation 

3.014675 

Ho:  There  is  no  preference  shown 

Sample  Variance 

9.088265 

Ha:  There  is  a  preference  shown 

Kurtosis 

-0.5477S 

Reject  the  null  hypothesis 

Skewness 

-0.983  IS 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

S 

preference  shown  favoring  high 

Sum 

1893 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.3565J 

Qll 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

171 

9 

1539 

Medium 

62 

5 

310 

Low 

44 

1 

44 

277 

1893 

6.83 

1 


2 


3 


4 


5 


6 


8 


9 
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Q12.  The  value  of  using  PDAs  to  reduce  medical  errors  (drug  interaction  warnings, 
dosage  calculators,  etc)  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  238  24 

15 

277 

Total 

238  24 

15 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

8.220217 

Degrees  of  Freedom  2 

Standard  Error 

0.124002 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  1.12E-75 

Standard  Deviation 

2.063807 

Hq:  There  is  no  preference  shown 

Sample  Variance 

4.2593 

Ha:  There  is  a  preference  shown 

Kurtosis 

5.832295 

Reject  the  null  hypothesis 

Skewness 

-2.6299f 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2277 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.24411 

Q12 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

238 

9 

2142 

Medium 

24 

5 

120 

Low 

15 

1 

15 

277 

2277 

8.22 
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013.  The  value  of  using  PDAs  for  personal  and  patient  scheduling  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  203  50 

24 

111 

Total 

203  50 

24 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.58483f 

Degrees  of  Freedom  2 

Standard  Error 

0.15264 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p- Value  lE-44 

Standard  Deviation 

2.54043f 

Hq:  There  is  no  preference  shown 

Sample  Variance 

6.453827 

Ha:  There  is  a  preference  shown 

Kurtosis 

1.249257 

Reject  the  null  hypothesis 

Skewness 

-1.5894f 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2101 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.300487 

Q13 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

203 

9 

1827 

Medium 

50 

5 

250 

Low 

24 

1 

24 

277 

2101 

7.58 

1 


2 


3 


4 


5 


6 


7 


9 
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014.  With  respect  to  PDAs,  cost  concerns  are: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  99  112 

66 

277 

Total 

99  112 

66 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

5.476534 

Degrees  of  Freedom  2 

Standard  Error 

0.18359C 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  12.18117 

Mode 

5 

p-Value  0.002264 

Standard  Deviation 

3.055701 

Hq:  There  is  no  preference  shown 

Sample  Variance 

9.33731 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.2589f 

Reject  the  null  hypothesis 

Skewness 

-0.20494 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring 

Sum 

1517 

medium  user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.36143; 

Q14 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

99 

9 

891 

Medium 

112 

5 

560 

Low 

66 

1 

66 

277 

1517 

5.48 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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Q15.  With  respect  to  PDAs,  network  security  concerns  are: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  Hlgb  Med 

Low 

Total 

Actual  Count  178  67 

32 

277 

Total 

178  67 

32 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.108303 

Degrees  of  Freedom  2 

Standard  Error 

0.16686f 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  4.68E-28 

Standard  Deviation 

2.777205 

Hq:  There  is  no  preference  shown 

Sample  Variance 

7.71286f 

Ha:  There  is  a  preference  shown 

Kurtosis 

-0.03572 

Reject  the  null  hypothesis 

Skewness 

-1.1442f 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

1965 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.328492 

Q15 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

178 

9 

1602 

Medium 

67 

5 

335 

Low 

32 

1 

32 

277 

1969 

7.11 

1 


2 


3 


4 


5 


6 


8 


9 
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016.  With  respect  to  PDAs,  patient  privacy  (HIPAA)  concerns  are: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  194  46 

37 

277 

Total 

194  46 

37 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.267 14^ 

Degrees  of  Freedom  2 

Standard  Error 

0.172398 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  2.76E-37 

Standard  Deviation 

2.869272 

Hq:  There  is  no  preference  shown 

Sample  Variance 

8.232721 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.247435 

Reject  the  null  hypothesis 

Skewness 

-1.33395 

At  the  .05  level  of  significance  we 

Range 

8 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2013 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.339382 

Q16 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

194 

9 

1746 

Medium 

46 

5 

230 

Low 

37 

1 

37 

277 

2013 

7.27 

1 


2 


3 


4 


5 


6 


fr  I  I 

7  8  9 
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017.  With  respect  to  PDAs,  ease  of  use  concerns  are: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  179  58 

40 

277 

Total 

179  58 

40 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.00722 

Degrees  of  Freedom  2 

Standard  Error 

0.176735 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  1.32E-27 

Standard  Deviation 

2.941445 

Hq:  There  is  no  preference  shown 

Sample  Variance 

8.652122 

Ha:  There  is  a  preference  shown 

Kurtosis 

-0.27012 

Reject  the  null  hypothesis 

Skewness 

-1.10755 

At  the  .05  level  of  significance  we 

Range 

f 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

1941 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.347915 

Q17 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

averse 

High 

179 

9 

1611 

Medium 

58 

5 

290 

Low 

40 

1 

40 

277 

1941 

7.01 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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018.  With  respect  to  PDAs,  the  ability  to  personalize  content  are: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  183  66 

28 

111 

Total 

00 

28 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.238267 

Degrees  of  Freedom  2 

Standard  Error 

0.16126f 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  2E-31 

Standard  Deviation 

2.684007 

Hq:  There  is  no  preference  shown 

Sample  Variance 

7.203893 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.23668f 

Reject  the  null  hypothesis 

Skewness 

-1.23385 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2005 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.31746J 

Q18 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

183 

9 

1647 

Medium 

66 

5 

330 

Low 

28 

1 

28 

277 

2005 

7.24 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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019.  With  respect  to  PDAs,  limited  application  storage  (internal  RAM) 

concerns  are: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  194  66 

17 

111 

Total 

194  66 

17 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.555957 

Degrees  of  Freedom  2 

Standard  Error 

0.143138 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  5.16E-40 

Standard  Deviation 

2.382285 

Hq:  There  is  no  preference  shown 

Sample  Variance 

5.6753 

Ha:  There  is  a  preference  shown 

Kurtosis 

0.998257 

Reject  the  null  hypothesis 

Skewness 

-1.43283 

At  the  .05  level  of  significance  we 

Range 

8 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2093 

user  value  in  this  area. 

Count 

HI 

Confidence  Level(95.0%) 

0.281781 

Q19 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

194 

9 

1746 

Medium 

66 

5 

330 

Low 

17 

1 

17 

HI 

2093 

7.56 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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020.  With  respect  to  PDAs,  a  color  display  is  important 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  92  85 

100 

111 

Total 

92  85 

100 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

4.884477 

Degrees  of  Freedom  2 

Standard  Error 

0.200334 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  1.220261 

Mode 

1 

p-Value  0.54328 

Standard  Deviation 

3.334227 

Ho:  There  is  no  preference  shown 

Sample  Variance 

11.11704 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.55997 

Fail  to  reject  the  null  hypothesis 

Skewness 

0.054331 

At  the  .05  level  of  significance  the  evidence 

Range 

does  not  allow  us  to  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  no 

Maximum 

c 

preference  shown  in  this  area. 

Sum 

1353 

Count 

277 

Confidence  Level(95.0%) 

0.394377 

Q20 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

92 

9 

828 

Medium 

85 

5 

425 

Low 

100 

1 

100 

277 

1353 

4.88 

1 


2 


3 


4 


6 


7 


8 


9 
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Q21.  With  respect  to  PDAs,  additional  functionality  (use  as  a  \oice  recorder,  beeper, 
etc.)  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  147  84 

46 

277 

Total 

147  84 

46 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.458484 

Degrees  of  Freedom  2 

Standard  Error 

0.18078f 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  5.75E-13 

Standard  Deviation 

3.008907 

Hq:  There  is  no  preference  shown 

Sample  Variance 

9.053524 

Ha:  There  is  a  preference  shown 

Kurtosis 

-0.8938f 

Reject  the  null  hypothesis 

Skewness 

-0.7138S 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

1785 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.35589^ 

Q21 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

147 

9 

1323 

Medium 

84 

5 

420 

Low 

46 

1 

46 

277 

1789 

6.46 

_ A _ 

123  456  789 
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022.  The  value  of  point -of-service 

patient  registration/admission  with  the  PDA  is 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  157  57 

63 

277 

Total 

157  57 

63 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.357401 

Degrees  of  Freedom  2 

Standard  Error 

0.198405 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  1.6E-15 

Standard  Deviation 

3.302182 

Ho:  There  is  no  preference  shown 

Sample  Variance 

10.90441 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.17227 

Reject  the  null  hypothesis 

Skewness 

-0.70262 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

1761 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.390587 

Q22 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

157 

9 

1413 

Medium 

57 

5 

285 

Low 

63 

1 

63 

277 

1761 

6.36 

_ A _ 

— Z2  A - 

123  456  789 
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023.  The  value  of  a  portable  (pocket  sized)  PDA 

is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  251  21 

5 

111 

Total 

251  21 

5 

HI 

Expected  Frequencies: 

Column  variable 

Row  triable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

8.552347 

Degrees  of  Freedom  2 

Standard  Error 

0.08862f 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p- Value  7.7E-90 

Standard  Deviation 

1.475027 

Hq:  There  is  no  preference  shown 

Sample  Variance 

2.175692 

Ha:  There  is  a  preference  shown 

Kurtosis 

12.31521 

Reject  the  null  hypothesis 

Skewness 

-3.49437 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2m 

user  value  in  this  area. 

Count 

211 

Confidence  Level(95.0%) 

0.17446f 

Q23 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

251 

9 

2259 

Medium 

21 

5 

105 

Low 

5 

1 

5 

277 

2369 

8.55 

1 


2 


3 


4 


5 


6 


7 


8 
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024.  The  value  of  medical  records  integration/access  with  a  PDA  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  202  52 

23 

111 

Total 

202  52 

23 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.58483f 

Degrees  of  Freedom  2 

Standard  Error 

0.151263 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  3.83E-44 

Standard  Deviation 

2.5 175  if 

Hq:  There  is  no  preference  shown 

Sample  Variance 

6.337885 

Ha:  There  is  a  preference  shown 

Kurtosis 

1.241911 

Reject  the  null  hypothesis 

Skewness 

-1.57652 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2101 

user  value  in  this  area. 

Count 

211 

Confidence  Level(95.0%) 

0.29777f 

Q24 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

202 

9 

1818 

Medium 

52 

5 

260 

Low 

23 

1 

23 

277 

2101 

7.58 

1 


2 


3 


4 


5 


6 


7 


9 
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Q25.  The  value  of  accessing  patient  information  at  the  point  of  patient  care 
PDA  is: 

with  a 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  225  29 

23 

277 

Total 

225  29 

23 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.91696S 

Degrees  of  Freedom  2 

Standard  Error 

0.14516f 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  7.36E-63 

Standard  Deviation 

2.416047 

Hq:  There  is  no  preference  shown 

Sample  Variance 

5.837284 

Ha:  There  is  a  preference  shown 

Kurtosis 

2.9503 

Reject  the  null  hypothesis 

Skewness 

-2.08 19^ 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2193 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.285774 

Q25 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

225 

9 

2025 

Medium 

29 

5 

145 

Low 

23 

1 

23 

277 

2193 

7.92 

1 


2 


3 


4 


5 


6 


7 


9 
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026.  The  value  of  standardized  medical/business  applications  on  the  PDA  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  224  36 

17 

111 

Total 

224  36 

17 

HI 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  92.33  92.33 

92.33 

216.% 

Total 

92.33  92.33 

92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

7.98917 

Degrees  of  Freedom  2 

Standard  Error 

0.13439c 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  2.61E-62 

Standard  Deviation 

2.236852 

Hq:  There  is  no  preference  shown 

Sample  Variance 

5.003505 

Ha:  There  is  a  preference  shown 

Kurtosis 

3.426572 

Reject  the  null  hypothesis 

Skewness 

-2.1306f 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2213 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.26457J 

Q26 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

224 

9 

2016 

Medium 

36 

5 

180 

Low 

17 

1 

17 

277 

2213 

7.99 

A 


L 

\ 

123  456  789 
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027.  The  minimum  PDA  delay  in 

screen  response  time  that  is  acceptable  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  1-5  sec  6-10  sec  lO-i-  sec 

Total 

Actual  Count  222  51  4 

277 

Total 

222  51  4 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  1-5  sec  6-10  sec  lO-i-  sec 

Total 

Expected  Count  92.33  92.33  92.33 

216.% 

Total 

92.33  92.33  92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

8. 1480 W 

Degrees  of  Freedom  2 

Standard  Error 

0.106733 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  1.22E-62 

Standard  Deviation 

1.77638f 

Ho:  There  is  no  preference  shown 

Sample  Variance 

3.15554C 

Ha:  There  is  a  preference  shown 

Kurtosis 

2.756275 

Reject  the  null  hypothesis 

Skewness 

-1.89762 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

2257 

user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.2101  W 

Q27 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

222 

9 

1998 

Medium 

51 

5 

255 

Low 

4 

1 

4 

277 

2257 

8.15 
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Q28.  The  number  of  acceptable 
is  located  is: 

screen  interactions  (scrolls)  until  desired  information 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  1-3  scrolls  4-6  scrolls  7+  scrolls 

Total 

Actual  Count  230  45 

2 

277 

Total 

230  45 

2 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  1-3  scrolls  4-6  scrolls  7+  scrolls 

Total 

Expected  Count  92.33  92.33 

92.33 

276.95 

Total 

92.33  92.33 

92.33 

276.95 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

8.292415 

Degrees  of  Freedom  2 

Standard  Error 

0.096322 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

5 

p-Value  9.26E-70 

Standard  Deviation 

1.603115 

Hq:  There  is  no  preference  shown 

Sampie  Variance 

2.569975 

Ha:  There  is  a  preference  shown 

Kurtosis 

3.134851 

Reject  the  null  hypothesis 

Skewness 

-2.03752 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

2297 

user  value  in  this  area. 

Count 

277 

Confidence  Levei(95.0%) 

0.189615 

Q28 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

230 

9 

2070 

Medium 

45 

5 

225 

Low 

2 

1 

2 

277 

2297 

8.29 

_ A _ 

123  456  789 
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029.  The  minimum  acceptable  battery  life  between  charges  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

0-4  hours  5-8  hours  9-12 

12-1- 

Row  variable 

(rounds)  (shift)  hours 

hours 

Total 

Actual  Count 

59  79  68 

71 

277 

Total 

59  79  68 

71 

277 

Expected  Frequencies: 

Column  variable 

04  hours  5-8  hours  9-12 

12h- 

Row  variable 

(rounds)  (shift)  hours 

hours 

Total 

Expected  Count 

69.25  69.25  69.25 

69.25 

277 

Total 

69.25  69.25  69.25 

69.25 

277 

Level  of  Significance 

0.05 

Hq:  There  is  no  preference  shown 

Number  of  Rows 

1 

Ha:  There  is  a  preference  shown 

Number  of  Columns 

4 

Fail  to  reject  the  null  hypothesis 

Degrees  of  Freedom 

3 

At  the  .05  level  of  significance  the  evidence 

Critical  Value 

7.814725 

does  not  allow  us  to  reject  the  null  hypothesis. 

Chi-Square  Test  Statistic 

2.956678 

Therefore,  there  appears  to  be  no 

p -Value 

0.398353 

preference  shown  in  this  area. 

Q30.  Currently,  are 
data  is  accurate: 

you  confident  that  CHCS  and  KG-ADS  patient  specific 

Cbi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  Yes  No 

Total 

Actual  Count  176 

100 

276 

Total  176 

100 

276 

Expected  Frequencies: 

Column  variable 

Row  variable  Yes  No 

Total 

Expected  Count  138 

138 

276 

Total  138 

138 

276 

Level  of  Significance 

0.05 

Hq:  There  is  no  preference  shown 

Number  of  Rows 

1 

Ha:  There  is  a  preference  shown 

Number  of  Columns 

3 

Reject  the  null  hypothesis 

Degrees  of  Freedom 

2 

At  the  .05  level  of  significance  we 

Critical  Value 

3.841455 

must  reject  the  null  hypothesis. 

Chi-Square  Test  Statistic 

20.84674 

Therefore,  there  appears  to  be  a 

p -Value 

4.77E-06 

preference  shown  favoring  high 

user  value  in  this  area. 
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031.  Are  you  frustrated  with  CHCS  and  KG-ADS  integration/operability: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  Yes  No 

Total 

Actual  Count  215 

61 

276 

Total  215 

61 

276 

Expected  Frequencies: 

Column  variable 

Row  variable  Yes  No 

Total 

Expected  Count  138 

138 

276 

Total  138 

138 

276 

Level  of  Significance 

0.05 

Hq:  There  is  no  preference  shown 

Number  of  Rows 

1 

Ha:  There  is  a  preference  shown 

Number  of  Columns 

3 

Reject  the  null  hypothesis 

Degrees  of  Freedom 

2 

At  the  .05  level  of  significance  we 

Critical  Value 

3.841455 

must  reject  the  null  hypothesis. 

Chi-Square  Test  Statistic 

#NUM! 

Therefore,  there  appears  to  be  a 

p -Value 

1.87E-20 

preference  shown  favoring  high 
user  value  in  this  area. 

Q32.  How  long  does  it  require  to  locate/  input  desired  information  (ICD-9/  CPT  codes) 

into  CHCS  n  and  KG-ADS: 

Chi-Square  Test 

Observed  Frequencies: 

1-5 

Column  variable 

6-10  11-15  16-20 

20-1- 

Row  variable  seconds 

seconds  seconds  seconds  seconds 

Total 

Actual  Count  88 

34  34  28 

90 

274 

Total  88 

34  34  28 

90 

274 

Expected  Erequencies: 

1-5 

Column  variable 

6-10  11-15  16-20 

20-1- 

Row  variable  seconds 

seconds  seconds  seconds  seconds 

Total 

Expected  Count  54.8 

54.8  54.8  54.8 

54.8 

274 

Total  54.8 

54.8  54.8  54.8 

54.8 

274 

Level  of  Significance 

0.05 

Hq:  There  is  no  preference  shown 

Number  of  Rows 

1 

Ha:  There  is  a  preference  shown 

Number  of  Columns 

5 

Reject  the  null  hypothesis 

Degrees  of  Freedom 

4 

At  the  .05  level  of  significance  the  evidence 

Critical  Value 

9.487728 

reject  the  null  hypothesis. 

Chi-Square  Test  Statistic 

#NUM! 

Therefore,  there  appears  to  be  a  preference  at  both 

p -Value 

1.03E-14 

.extremes  for  this 

area. 

*  Q33-Q35  have  significantly  fewer  responses.  These  questions  were  added  based  upon  Delphi  roundtable 
sessions  with  providers  at  Naval  Hospital  Lemoore  after  they  had  taken  the  survey,  and  thus  do  not  reflect 
their  answers. 
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033.  The  value  of  integrating  voice  transcription  services  on  the  PDA  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med  Low 

Total 

Actual  Count  150  45 

57 

252 

Total 

150  45 

57 

252 

Expected  Frequencies: 

Column  variable 

Row  variable  Hlgb  Med  Low 

Total 

Expected  Count  84  84 

84 

252 

Total 

84  84 

84 

252 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.4761C 

Degrees  of  Freedom  2 

Standard  Error 

0.20899S 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  8.37E-18 

Standard  Deviation 

3.31774 

Hq:  There  is  no  preference  shown 

Sample  Variance 

11.0074 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.0977 

Reject  the  null  hypothesis 

Skewness 

-0.78012 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

c 

preference  shown  favoring  high 

Sum 

1632 

user  value  in  this  area. 

Count 

252 

Confidence  Level(95.0%) 

0.411612 

Q33 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

150 

9 

1350 

Medium 

45 

5 

225 

Low 

57 

1 

57 

252 

1632 

6.48 

1 


2 


3 


4 


5 


6 


7 


8 


9 
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034.  The  value  of  providing  an  audio  alert  for  high-priority  e-mail  on  the  PDA  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  129  68 

55  252 

Total 

129  68 

55  252 

Expected  Frequencies: 

Column  variable 

Row  variable  Hlgb  Med 

Low 

Total 

Expected  Count  84  84 

84  252 

Total 

84  84 

84  252 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.174602 

Degrees  of  Freedom  2 

Standard  Error 

0.202601 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  8.5E-09 

Standard  Deviation 

3.216192 

Hq:  There  is  no  preference  shown 

Sample  Variance 

10.34385 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.2138^ 

Reject  the  null  hypothesis 

Skewness 

-0.582 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

155f 

user  value  in  this  area. 

Count 

252 

Confidence  Level(95.0%) 

0.399015 

Q34 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

129 

9 

1161 

Medium 

68 

5 

340 

Low 

55 

1 

55 

252 

1556 

6.17 

1 


2 


3 


4 


5 


7 


8 


9 
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Q35.  The  value  of  integrating  barcode  scanning  capability  (match  medications  with 
patient,  associate  material  costs  with  episodes  of  care/inventory  control)  on  the  PDA 
is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Actual  Count  154  49 

49 

252 

Total 

154  49 

49 

252 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med 

Low 

Total 

Expected  Count  84  84 

84 

252 

Total 

84  84 

84 

252 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

6.666667 

Degrees  of  Freedom  2 

Standard  Error 

0.200707 

Critical  Value  5.991476 

Median 

c 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  9.99E-20 

Standard  Deviation 

3.186125 

Hq:  There  is  no  preference  shown 

Sample  Variance 

10.15135 

Ha:  There  is  a  preference  shown 

Kurtosis 

-0.8398f 

Reject  the  null  hypothesis 

Skewness 

-0.89232 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

168C 

user  value  in  this  area. 

Count 

252 

Confidence  Level(95.0%) 

0.395285 

Q35 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

154 

9 

1386 

Medium 

49 

5 

245 

Low 

49 

1 

49 

252 

1680 

6.67 

1 


2 


3 


4 


5 


6 


8 


9 
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Q36.  The  value  of  utilizing  medical  imaging  (low-level  diagnostic  display  capability) 
on  the  PDA  is: 

Chi-Square  Test 

Observed  Frequencies: 

Column  variable 

Row  variable  High  Med  Low 

Total 

Actual  Count  129  56  92 

277 

Total 

129  56  92 

277 

Expected  Frequencies: 

Column  variable 

Row  variable  High  Med  Low 

Total 

Expected  Count  92.33  92.33  92.33 

216.% 

Total 

92.33  92.33  92.33 

216.% 

Level  of  Significance  0.05 

Number  of  Rows  1 

Descriptive  Statistics 

Number  of  Columns  3 

Mean 

5.53429f 

Degrees  of  Freedom  2 

Standard  Error 

0.212643 

Critical  Value  5.991476 

Median 

5 

Chi-Square  Test  Statistic  #NUM! 

Mode 

c 

p-Value  5.41E-07 

Standard  Deviation 

3.5390^ 

Hq;  There  is  no  preference  shown 

Sample  Variance 

12.52505 

Ha:  There  is  a  preference  shown 

Kurtosis 

-1.67561 

Reject  the  null  hypothesis 

Skewness 

-0.26472 

At  the  .05  level  of  significance  we 

Range 

must  reject  the  null  hypothesis. 

Minimum 

1 

Therefore,  there  appears  to  be  a 

Maximum 

5 

preference  shown  favoring  high 

Sum 

1533 

and  low  user  value  in  this  area. 

Count 

277 

Confidence  Level(95.0%) 

0.41860^ 

Q36 

Survey  Responses 

Weight 

Weighted 

value 

Weighted 

average 

High 

129 

9 

1161 

Medium 

56 

5 

280 

Low 

92 

1 

92 

277 

1533 

5.53 

123  456  789 
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APPENDIX  C.  RAW  DATA 
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APPENDIX  D.  BUMED  DRAET  INSTRUCTION  ON  PERSONAL 
DIGITAL  ASSISTANT  GUIDANCE 


BUMEDINST  5230.XX 
BUMED-09D 


BUMED  INSTRUCTION  5230.XX 


Erom:  Chief,  Bureau  of  Medicine  and  Surgery 

Subj :  USE  OE  PERSONAE  DIGITAE  ASSISTANTS  (PDAS) 

Ref:  (a)  EETINEOWARCEN  13 130IZ  JUE  00 

(b)  SECDEE  memo  of  14  Jul  00 

(c)  DON  CIO  memo  of  8  Aug  00 

(d)  CNO  WASHINGTON  272200Z  APR  01 

(e)  Privacy  Act  of  1974 

(f)  Public  Eaw  104- I9I;  Health  Insurance  Portabihty  and  Accountabihty  Act 
(HIPPA) 

Enel:  (1)  Personal  Digital  Assistant  (PDA)  Use  Agreement 

1.  Purpose.  To  promulgate  policy  on  the  use  of  PDAs  and  associated  personal 
computing  devices  that  connect  to  network  automated  information  systems  (AIS)  in 
accordance  with  references  (a)  through  (f). 

2.  Scope.  This  policy  applies  to  Claimancy  18  personnel,  including  contractors,  who 
operate  PDAs  connected  to: 

a.  Bureau  of  Medicine  and  Surgery  (BUMED)  network. 

b.  Naval  Medical  Information  Management  Center  (NMIMC)  network. 

c.  Personal  computers  used  within  Claimancy  18. 

d.  Other  network- connected  AIS  within  the  Claimancy. 

3.  Background 


a.  There  are  two  basic  classes  of  PDAs:  those  using  the  Palm  Operating  System  (Palm 
Pilots,  Handspring  Visor,  etc.);  and  those  mnning  Windows  CE  and  Pocket  PC  (Compaq, 
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HP  Jornada,  Casio,  etc.).  PDAs  can  have  a  wide  variety  of  accessories,  including 
modems,  synchronization  cables,  wireless  connections,  and  flash  memory  storage. 

b.  Both  the  Palm  OS  and  Windows  CE  operating  systems  have  software  hbraries  with 
apphcations  being  developed  and  distributed  through  both  the  commercial  and  freeware/ 
shareware  channels.  As  with  any  software  developed  by  non- govemmental/non- trusted 
sources,  there  is  the  possibihty  that  some  programs  may  contain  Trojan  Horse  code,  i.e., 
code  hidden  within  an  apphcation  without  the  user's  knowledge. 

c.  Reference  (a)  discusses  security  considerations  that  should  be  implemented  prior  to 
the  use  of  PDAs.  Reference  (b)  addresses  he  use  and  protection  of  personal  computing 
devices.  Reference  (c)  addresses  the  need  for  activities  to  review  their  pohcies  and 
procedures  for  protecting  and  accounting  for  portable  computing  devices,  particularly 
those  devices  used  to  process  or  store  classified  information.  Reference  (d)  provides 
guidance  for  use  of  portable  electronic  devices  in  the  Navy. 

d.  PDAs  are  another  storage  medium  like  hard  drives,  diskettes,  and  paper  records. 
When  these  media  contain  sensitive  but  unclassified  patient-related  data,  they  must  be 
safeguarded  against  unauthorized  disclosure,  modification,  or  destmction  in  accordance 
with  reference  (e),  the  Privacy  Act  of  1974,  which  addresses  the  establishment  of  any 
Eederal  Agency  national  data  bank  that  combines,  merges,  or  links  computerized 
information  on  individuals  maintained  in  systems  of  record.  In  addition,  reference  (f),  the 
HIPPA  of  1996,  established  standards  and  requirements  for  the  electronic  transmission  of 
health  information. 

e.  Other  vulnerabihties  may  exist  when  using  PDAs  attached  to  personal  computers 
or  other  network  connected  AIS.  The  main  risks  associated  with  this  usage  are: 

(1)  A  well- written  Trojan  Horse  program  could,  among  things,  install  a  backdoor 
on  host  networks  to  permit  hacker  exploitation. 

(2)  A  wireless  palm  connection  can  be  used  to  transmit  and  receive  data  to  and 
from  a  personal  computer  (PC)  without  the  knowledge  or  permission  of  the  user. 

(3)  Antivirus  products  for  handheld  and  mobile  devices  are  not  as  well  developed 
as  PC  antivims  software  because  the  use  of  PDAs  has  only  recently  become  routine. 

(4)  Unlike  desktop  PCs,  PDA  operating  systems  do  not  limit  mahcious  code  from 
modifying  system  files. 

(5)  A  PDA  utilizes  infrared  transport  technology,  which  allows  users  to  transmit 
data  to  other  PDA’S,  thus  circumventing  Information  Technology  (IT)  and  physical 
security  processes  of  an  activity. 
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4.  Policy 

a.  PDAs  have  the  potential  to  provide  business  process  improvements  through  the 
elimination  of  double  entries  of  information  ordinarily  shared  between  PCs  and  PDAs. 
Designated  Approval  Authorities  (DAAs),  normally  Commanding  Officer  of  an  activity, 
may  authorize  the  use  of  PDAs  and  the  connection  of  PDAs  to  networked  PCs  if 
technical  personnel  review  the  vulnerabihties  in  paragraph  3,  address  the  vulnerabihties 
that  can  be  eliminated  or  mitigated,  and  fist  the  risks  and  mitigation  strategies  associated 
with  the  remaining  vulnerabilities.  The  DAA  may  then  elect  to  accept  the  vulnerabihties 
and  authorize  the  use  of  PDAs. 

b.  Claimancy  18  commands  will  approve  in  writing  the  use  of  PDAs  before  they  are 
connected  to  BUMED/NMIMC  resources  (computers,  printers,  monitors  or  the  network). 

c.  Prospective  PDA  users  wiU  sign  an  agreement  similar  to  enclosure  (1). 

d.  It  is  strongly  recommended  that  the  following  security  measures  be  adopted  for  the 
use  of  PDAs  that  synchronize  with  computers  on  BUMED/NMIMC  and  all  Claimancy  18 
networks : 

(1)  Use  only  government  and  commercially- produced  applications  or  applications 
developed  by  trusted  sources. 

(2)  A  PDA  may  not  be  used  to  enter  passwords,  combinations,  PINs  or  classified 
information. 

(3)  In  regards  to  PDA  remote  connectivity  features: 

(a)  Allow  no  upload/download  via  wireless  or  infrared,  while  connected  to  a 
desktop  PC,  particularly  a  networked  PC. 

(b)  Use  infrared  only  for  authorized  Palm  to  Pahn  data  transfers. 

(4)  PDAs  can  be  used  to  carry  data  from  a  desktop  workstation.  This  includes 
carrying  schedules,  contact  information,  notes,  e-mail  and  other  items  from  Microsoft 
Outlook. 


(5)  PDAs  can  be  used  to  take  notes,  save  information  or  write  emails  while  away 
from  a  desktop  PC,  whether  down  the  haU  or  out  of  the  country. 

(6)  PDAs  can  be  used  to  synchronize  information  with  your  desktop  workstation 
using  direct- connect  cables  or  via  an  authorized  infrared  port.. 

(7)  PDAs  will  not  be  used  with  commercial  Internet  Service  Providers. 
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(8)  PDAs  will  not  be  used  with  modems  to  exehange  information  with  your 
desktop  or  other  systems  on  the  network. 

(9)  PDAs  ean  eonneet  to  synchronize  files  between  an  authorized  PDA  and  the 
designated  PC  or  designated  infrared  port  specified  in  enclosure  (1).  PDAs  will  not  be 
used  to  synchronize  files  or  devices  across  the  network;  AU  network  synchronization 
features  wiU  be  disabled  before  connecting  to  the  network. 

(10)  PDAs  may  not  be  used  to  arbitrarily  download  and  load  freeware  or  shareware 
software  or  enhancements.  Such  software  is  from  untmsted  sources  and  may  contain 
malicious  code. 

(11)  PDAs  wiU  not  be  left  unattended  when  attached  to  a  computer. 

(12)  PDAs  wiU  be  secured  when  not  in  use. 

(13)  Command  issued  PDAs  wiU  only  be  used  for  official  government  business. 

(14)  Use  of  personally  owned  PDAs  is  discouraged,  but  may  be  approved  by  the 
local  Designated  Approval  Authority  (DAA)  on  a  case-by-case  basis. 

e.  AU  personaUy  owned  PDAs  wiU  conform  to  this  poUcy.  Failure  to  comply  with 
this  poUcy  wiU  result  in  loss  of  PDA  use  privileges. 

5.  Action.  Chief  Information  Officers  (CIOs)  wiU  ensure  that  the  provisions  of  this 
instmction,  and  related  guidance,  are  adhered  to.  This  is  rapidly  developing  technology 
with  great  potential  to  improve  business  efficiency,  but  with  an  equaUy  great  potential  to 
endanger  the  privacy  of  patient  data.  Authorization  to  use  PDAs  in  Claimancy  18 
activities  is  not  a  privUege  to  be  taken  tightly. 


Etistribution: 

AU  Internal  BUMED  Codes 

SNDE,  C28G  (BRDENCEINIC,  EANT) 

C28H  (BRMEDCEINIC,  EANT) 

C31D  (BRDENCEINIC,  PAC) 

C31J  (BRMEDCEINIC,  PAC) 

C31K  (MEDADMINU,  PAC) 

C34F  (BRMEDCEINIC,  EUR) 

C34G  (BRDENCEINIC,  EUR) 

C52  (SHORE  BASED  DETS,  BUMED) 
C58A  (BRDENCEINIC,  CNET) 

C85A  (BRMEDCEINIC,  NAVDIS) 
FA4  (AMBCARECEN,  EANTFET) 
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Distribution  (continued): 


FA40  (NAVHLTHCARE) 

FA47  (HOSP/MEDCEN,  EANT) 

FA48  (DENCEN,  EANT) 

FB58  (HOSP/MEDCEN,  EANT) 

SNDE,  FB59  (DENCEN,  PAC) 

FB60  (MEDCEINIC,  PAC) 

FB9  (AMBCARECEN,  PACFET) 

EC  16  (MEDCEINIC,  EUR) 

EC  17  (HOSPITAE,  EUR) 

EC  18  (DENCEN,  EUR) 

FF72  (MEDCEINIC,  NAVAE  ACADEMY) 
FG15  (NAVENPVNTMEDU) 

EH  16  (DISVECTECOECONCEN) 

FH2  (FEEHOSPSUPPOFF) 

FH20  (NAVHETHRSCHCENO 
FH21  (NAVOPTHAESUPPTRACT) 
FH22  (NAVDENTAERSCHINSTITUTE) 
FH24  (NAVMEDINFOMGMTCEN) 
FH26  (NAVENVIRHETHCEN) 

FH33  (NAVDRUGEAB) 

FH35  (FEEHOSPOTC) 

FH36  (NAVHETHCARESUPPO) 

FH38  (MIEMEDSUPPOFF) 

FH4  (NAVMEDEOGCOM) 

FH5  (EABORATORY,  MEDICAE) 

FH6  (NAVMEDRSCHCEN) 

FH8  (NAVMEDRSCHU) 

FT108  (HOSPITAE,  CNET) 

FT109  (DENCEN,  CNET) 

Fr4  (AMBCARECEN,  CNET) 

FWl  (NATNAVMEDCEN) 

FW2  (NATNAVDENCEN) 

FW4  (NAVMEDCEINIC,  NDW) 
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PERSONAL  DIGITAL  ASSISTANTS  (PDA)  CERTIFICATION/ACCREDITATION 

WORKSHEET 

PDA  Information 

1 .  Manufacturer: _ Model: _ Serial  Number: _ 

2.  Software  Installed  on  PDA: _ 

3.  Department  where  PDA  will  be  located/used: _ 

4.  Navy  Property  Account  Number  of  CPU  or  designated  server  on  which  PDA  software  will  he  installed: _ 


PDA  Policy 


1 .  Personal  Digital  Assistants: 

a.  will  be  secured  when  not  in  use. 

b.  will  only  be  connected  to  the  Command  Information  System  listed  above. 

c.  will  conform  to  approved  DOD  standards  of  operation  for  Information  Systems. 

d.  may  be  used  to  carry  information  from  a  desktop  workstation,  including  schedules,  contact  information,  notes,  and  e-mail 

items  from  Microsoft  Outlook. 

e.  may  be  used  to  take  notes,  save  information  or  write  e-mails  while  away  from  PDA  user’s  desk. 

f .  may  be  used  to  synchronize  information  with  PDA  user’ s  desktop  workstation  using  direct  connect  cables  or  via  an  authorized  infrared 
port. 

2.  Personal  Digital  Assistants  will  NOT  be: 

a.  used  to  process  or  store  classified  information. 

b.  connected  to  any  classified  Information  System  or  network. 

c.  used  to  connect  to  commercial  Internet  Service  Providers. 

d.  used  with  modems  to  exchange  information  with  PDA  user’s  desktop  or  other  systems  on  the  network. 

e.  used  to  synchronize  any  equipment  features  or  devices  across  any  network. 

f.  used  to  download  and  install  freeware  or  shareware  software  enhancements  to  PDAs.  Such  software  is  from  untrusted 

sources  and  may  contain  malicious  code. 

g.  left  unattended  while  attached  to  a  government  Information  System. 

3.  Please  contact  your  Information  Systems  Security  Manager  (ISSM)  if  you  have  any  questions  or  concerns  regarding  this  policy. 

fPA  Use  Agreemenj 

1.  I  have  read  and  understand  the  security  guidelines  in  Personal  Digital  Assistant  (PDA)  use  Policy.  I  further  understand  the  necessity  for 
safeguarding  my  personal  data  assistant  and  recognize  the  requirement  for  maintaining  confidentiality  of  all  data  stored  in  it. 

2.  I  agree  to  abide  by  the  strict  policy  outlined  above  and  understand  that  failure  to  comply  will  result  in  the  loss  of  my  PDA 


use  privilege. 

ISSM  Information 

Date: 

USER  Information 

Date: 

Name: 

Name: 

Title: 

Title: 

Sifinature: 

Remember  that  your  Personal  Digital  Assistant  (PDA)  is  for  OFFICIAL  USE  ONLY.  If  you  are  using  personal  owned  PDA  that  has  been  approved  by 
your  Command  for  use  at  work,  the  Command  and  BUMED/NMIMC  are  not  responsible  for  theft,  inappropriate  use,  and  haidwarecrsoftwaie  Mines  of 
that  PDA  or  any  other  incidental  loss.  All  users  of  personal  owned  PDAs  must  follow  all  of  the  command’s  guidelines. 
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